Jul 19 19:39:55 devstack cinder-volume[76260]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 19 19:39:55 devstack cinder-volume[76260]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 19 19:39:55 devstack cinder-volume[76260]: we strongly recommend against using it for new projects.
Jul 19 19:39:55 devstack cinder-volume[76260]: If you are already using Eventlet, we recommend migrating to a different
Jul 19 19:39:55 devstack cinder-volume[76260]: framework.  For more detail see
Jul 19 19:39:55 devstack cinder-volume[76260]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 19 19:39:55 devstack cinder-volume[76260]:   import eventlet  # noqa
Jul 19 19:39:58 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 19 19:39:58 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 19 19:39:58 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 19 19:39:59 devstack cinder-volume[76260]: INFO dbcounter [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Registered counter for database cinder
Jul 19 19:39:59 devstack cinder-volume[76260]: DEBUG oslo_db.sqlalchemy.engines [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writer thread running {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 19 19:40:00 devstack cinder-volume[76260]: INFO cinder.rpc [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 19 19:40:00 devstack cinder-volume[76260]: INFO cinder.rpc [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_db.sqlalchemy.engines [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:40:00 devstack cinder-volume[76260]: INFO cinder.volume.manager [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Determined volume DB was empty at startup.
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG cinder.volume.manager [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76260) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 19 19:40:00 devstack cinder-volume[76260]: INFO cinder.volume.manager [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 19 19:40:00 devstack cinder-volume[76260]: WARNING stevedore.named [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 19 19:40:00 devstack cinder-volume[76260]: WARNING castellan.key_manager [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 19 19:40:00 devstack cinder-volume[76260]: WARNING cinder.keymgr.conf_key_mgr [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG cinder.volume.drivers.lvm [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76260) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_concurrency.processutils [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] CMD "cinder-rtstool verify" returned: 0 in 0.481s {{(pid=76260) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_db.sqlalchemy.engines [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:40:00 devstack cinder-volume[76260]: INFO cinder.rpc [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 19 19:40:00 devstack cinder-volume[76260]: INFO cinder.rpc [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 19 19:40:00 devstack cinder-volume[76260]: WARNING stevedore.named [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 19 19:40:00 devstack cinder-volume[76260]: WARNING castellan.key_manager [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 19 19:40:00 devstack cinder-volume[76260]: INFO cinder.volume.manager [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_db.sqlalchemy.engines [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:40:00 devstack cinder-volume[76260]: INFO oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Starting 1 workers
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Started child 76395 {{(pid=76260) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Full set of CONF: {{(pid=76260) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] ******************************************************************************** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Configuration options gathered from: {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 19 19:40:00 devstack cinder-volume[76395]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] ================================================================================ {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] allow_availability_zone_fallback = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] allow_compression_on_image_upload = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] allowed_direct_url_schemes     = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] api_rate_limit                 = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] auth_strategy                  = keystone {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] az_cache_duration              = 3600 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_availability_zone      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_host                   = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_name                   = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_stats_polling_interval = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backup_api_class               = cinder.backup.api.API {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backup_name_template           = backup-%s {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backup_use_same_host           = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backup_use_temp_snapshot       = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] chap_password                  = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] chap_username                  =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_internal_tenant_project_id = ef02ebb4ee194506b17fb6d9ab9298b3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_internal_tenant_user_id = cbbb5d80ff39479b9ca901e0b62944de {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cloned_volume_same_az          = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cluster                        = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] compression_format             = gzip {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] config_dir                     = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] config_source                  = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] control_exchange               = openstack {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] debug                          = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] default_availability_zone      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] default_group_type             = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] default_volume_type            = lvmdriver-1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] disk_geometry                  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] driver_client_cert             = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] driver_client_cert_key         = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] driver_data_namespace          = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] driver_ssl_cert_path           = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] driver_ssl_cert_verify         = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] driver_use_ssl                 = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] enable_force_upload            = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] enable_new_services            = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] enable_unsupported_driver      = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] enforce_multipath_for_image_xfer = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] filter_function                = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_api_insecure            = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76395]: INFO cinder.volume.manager [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_api_servers             = ['http://192.168.122.70/image'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_api_ssl_compression     = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_ca_certificates_file    = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_certfile                = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_keyfile                 = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_num_retries             = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance_request_timeout         = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] goodness_function              = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] graceful_shutdown_timeout      = 5 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] group_api_class                = cinder.group.api.API {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] host                           = devstack {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_compress_on_upload       = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_conversion_address_space_limit = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_conversion_cpu_limit     = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_conversion_disable       = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_upload_use_cinder_backend = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_upload_use_internal_tenant = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_volume_cache_enabled     = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_volume_cache_max_count   = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] image_volume_cache_max_size_gb = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] init_host_max_objects_retrieval = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] iscsi_target_flags             =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] iscsi_write_cache              = on {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] iser_helper                    = tgtadm {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] iser_ip_address                = 192.168.122.70 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] iser_port                      = 3260 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_color                      = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_config_append              = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_dir                        = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_file                       = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_options                    = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_rotate_interval            = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_rotate_interval_type       = days {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] log_rotation_type              = none {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] max_age                        = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] max_logfile_count              = 30 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] max_logfile_size_mb            = 200 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] max_over_subscription_ratio    = 20.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] message_reap_interval          = 86400 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] message_ttl                    = 2592000 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] migration_create_volume_timeout_secs = 300 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] monkey_patch                   = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] monkey_patch_modules           = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] my_ip                          = 192.168.122.70 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] no_snapshot_gb_quota           = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] num_iser_scan_tries            = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] num_shell_tries                = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] num_volume_device_scan_tries   = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] nvmeof_conn_info_version       = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] nvmet_ns_id                    = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] nvmet_port_id                  = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] osapi_max_limit                = 1000 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] osapi_volume_ext_list          = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] osapi_volume_listen_port       = 8776 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] osapi_volume_use_ssl           = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] osapi_volume_workers           = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] per_volume_size_limit          = -1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] periodic_fuzzy_delay           = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] periodic_interval              = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] public_endpoint                = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] publish_errors                 = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] quota_backup_gigabytes         = 1000 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] quota_backups                  = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] quota_gigabytes                = 1000 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] quota_groups                   = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] quota_snapshots                = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] quota_volumes                  = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] rate_limit_burst               = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] rate_limit_except_level        = CRITICAL {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] rate_limit_interval            = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] reinit_driver_count            = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] replication_device             = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] report_discard_supported       = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] report_interval                = 120 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] reservation_clean_interval     = 86400 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] reservation_expire             = 86400 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] reserved_image_namespaces      = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] reserved_percentage            = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:00 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] rpc_response_timeout           = 120 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] run_external_periodic_tasks    = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] scst_target_driver             = iscsi {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] scst_target_iqn_name           = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_down_time              = 720 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] shell_completion               = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] snapshot_name_template         = snapshot-%s {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] snapshot_same_host             = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] split_loggers                  = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] state_path                     = /opt/stack/data/cinder {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] storage_availability_zone      = nova {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] storage_protocol               = iSCSI {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] syslog_log_facility            = LOG_USER {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] target_helper                  = lioadm {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] target_ip_address              = 192.168.122.70 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] target_port                    = 3260 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] target_protocol                = iscsi {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] target_secondary_ip_addresses  = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] trace_flags                    = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] transport_url                  = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] until_refresh                  = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] use_chap_auth                  = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] use_default_quota_class        = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] use_journal                    = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] use_json                       = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] use_multipath_for_image_xfer   = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] use_stderr                     = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] use_syslog                     = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] verify_glance_signatures       = enabled {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_api_class               = cinder.volume.api.API {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_backend_name            = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_clear                   = zero {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_clear_ionice            = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_clear_size              = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_copy_bps_limit          = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_dd_blocksize            = 1M {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_name_template           = volume-%s {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_service_inithost_offload = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volume_usage_audit_period      = month {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] zoning_mode                    = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_concurrency.disable_process_locking = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.auth_section = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.auth_type   = password {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.auth_version = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.cache       = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.certfile    = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.include_service_catalog = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.insecure    = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.interface   = public {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.keyfile     = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_password =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcache_username =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.region_name = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.service_type = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.70/identity {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.backend                  = dogpile.cache.null {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.backend_argument         = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.backend_expiration_time  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.config_prefix            = cache.oslo {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.debug_cache_backend      = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.enable_retry_client      = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.enable_socket_keepalive  = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.enabled                  = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack sudo[76399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.expiration_time          = 600 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.hashclient_retry_attempts = 2 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.memcache_dead_retry      = 300 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.memcache_sasl_enabled    = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.password                 = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.proxies                  = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.redis_db                 = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.redis_server             = localhost:6379 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.retry_attempts           = 2 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.retry_delay              = 0.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.socket_keepalive_count   = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.socket_keepalive_idle    = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.socket_keepalive_interval = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.socket_timeout           = 1.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.tls_allowed_ciphers      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.tls_cafile               = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.tls_certfile             = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.tls_enabled              = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.tls_keyfile              = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cache.username                 = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] coordination.backend_url       = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.asyncio_connection    = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.asyncio_slave_connection = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.backend               = sqlalchemy {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.connection            = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.connection_debug      = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.connection_parameters =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.connection_recycle_time = 3600 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.connection_trace      = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.db_inc_retry_interval = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.db_max_retries        = 20 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.db_max_retry_interval = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.db_retry_interval     = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.max_overflow          = 50 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.max_pool_size         = 5 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.max_retries           = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.mysql_wsrep_sync_wait = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.pool_timeout          = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.retry_interval        = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.slave_connection      = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.sqlite_synchronous    = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.synchronous_reader    = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] database.use_db_reconnect      = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.connection_string     = messaging:// {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.enabled               = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.es_doc_type           = notification {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.es_scroll_size        = 10000 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.es_scroll_time        = 2m {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.filter_error_trace    = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.hmac_keys             = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.sentinel_service_name = mymaster {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.socket_timeout        = 0.1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.trace_requests        = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler.trace_sqlalchemy      = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler_jaeger.process_tags   = {} {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler_jaeger.service_name_prefix = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] profiler_otlp.service_name_prefix = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.enforce_new_defaults = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.policy_default_rule = default {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] privsep_osbrick.group          = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] privsep_osbrick.helper_command = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] privsep_osbrick.user           = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_sys_admin.group         = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_sys_admin.helper_command = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] cinder_sys_admin.user          = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.auth_section      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.auth_type         = password {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.cafile            = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.certfile          = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.collect_timing    = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.insecure          = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.keyfile           = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.send_service_user_token = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.split_loggers     = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] service_user.timeout           = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.auth_section            = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.auth_type               = password {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.certfile                = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.collect_timing          = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.insecure                = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.keyfile                 = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.region_name             = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.split_loggers           = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] glance.timeout                 = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.backend_availability_zone = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.chap_password = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.chap_username =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.disk_geometry = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.driver_client_cert = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.driver_client_cert_key = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.driver_data_namespace = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.driver_use_ssl = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.extra_capabilities = {} {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.filter_function = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.goodness_function = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.iscsi_target_flags =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.iscsi_write_cache = on {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.iser_ip_address = 192.168.122.70 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.iser_port     = 3260 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.lvm_share_target = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.lvm_type      = auto {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.num_shell_tries = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.replication_device = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.report_discard_supported = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.reserved_percentage = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.target_helper = tgtadm {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.target_ip_address = 192.168.122.70 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.target_port   = 3260 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.target_protocol = iscsi {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.trace_flags   = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.unique_fqdn_network = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.use_chap_auth = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_backend_name = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_clear  = zero {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_clear_ionice = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_clear_size = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_reports.file_event_handler = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_reports.log_dir           = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.backend_host       = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.chap_password      = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.chap_username      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.disk_geometry      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.driver_client_cert = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.extra_capabilities = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.filter_function    = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.goodness_function  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.iser_helper        = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.iser_port          = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.lvm_type           = auto {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.replication_device = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.report_discard_supported = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.reserved_percentage = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.scst_target_driver = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.storage_protocol   = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.target_ip_address  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.target_port        = 3260 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.trace_flags        = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_clear       = zero {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] lvmdriver-1.volumes_dir        = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_notifications.driver = [] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_notifications.retry = -1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] key_manager.fixed_key          = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.barbican_api_version  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.barbican_endpoint     = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.barbican_endpoint_type = public {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.barbican_region_name  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.cafile                = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.certfile              = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.collect_timing        = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.insecure              = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.keyfile               = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.number_of_retries     = 60 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.retry_delay           = 1 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.send_service_user_token = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.split_loggers         = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.timeout               = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.verify_ssl            = True {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican.verify_ssl_path       = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.auth_section = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.auth_type = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.cafile   = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.certfile = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.collect_timing = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.insecure = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.keyfile  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.split_loggers = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] barbican_service_user.timeout  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.approle_role_id          = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.approle_secret_id        = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.auth_method              = approle {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.auth_path                = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.kv_mountpoint            = secret {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.kv_path                  = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.kv_version               = 2 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.namespace                = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.root_token_id            = **** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.ssl_ca_crt_file          = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.timeout                  = 60.0 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.token_file               = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.token_role               = None {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.use_ssl                  = False {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:40:01 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] ******************************************************************************** {{(pid=76260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 19 19:40:01 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:01 devstack sudo[76530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:01 devstack sudo[76530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:01 devstack sudo[76530]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.266s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:40:01 devstack cinder-volume[76395]: INFO cinder.brick.local_dev.lvm [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:01 devstack sudo[76626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:40:01 devstack sudo[76626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:01 devstack sudo[76626]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG cinder.brick.local_dev.lvm [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76395) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Jul 19 19:40:01 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:01 devstack sudo[76710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:01 devstack sudo[76710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:02 devstack sudo[76710]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:02 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.524s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:02 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:02 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:02 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:02 devstack sudo[76904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:02 devstack sudo[76904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:02 devstack sudo[76904]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:02 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.330s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:02 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:02 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:02 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:02 devstack sudo[77007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 19 19:40:02 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:03 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:03 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.252s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:03 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:03 devstack sudo[77010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:40:03 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:03 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:03 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:03 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:03 devstack sudo[77093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:40:03 devstack sudo[77093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:03 devstack sudo[77093]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:03 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:03 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:03 devstack sudo[77096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:40:03 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:03 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:03 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:03 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:03 devstack sudo[77149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:03 devstack sudo[77149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:04 devstack sudo[77149]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:04 devstack sudo[77189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:04 devstack sudo[77189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:04 devstack sudo[77189]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:04 devstack cinder-volume[76395]: INFO cinder.volume.drivers.lvm [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:04 devstack sudo[77193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:04 devstack sudo[77193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:04 devstack sudo[77193]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG cinder.volume.drivers.lvm [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Updating volume stats {{(pid=76395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 19 19:40:04 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:04 devstack sudo[77196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:40:04 devstack sudo[77196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:05 devstack sudo[77196]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:05 devstack sudo[77199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:40:05 devstack sudo[77199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:05 devstack sudo[77199]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:05 devstack sudo[77208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:05 devstack sudo[77208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:05 devstack sudo[77208]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:05 devstack sudo[77212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:40:05 devstack sudo[77212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:05 devstack sudo[77212]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:05 devstack cinder-volume[76395]: INFO cinder.volume.driver [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Driver hasn't implemented _init_vendor_properties()
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG cinder.volume.driver [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76395) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 19 19:40:05 devstack cinder-volume[76395]: DEBUG oslo_db.sqlalchemy.engines [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG dbcounter [-] [76395] Writer thread running {{(pid=76395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG cinder.db.api [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Building query based on filter {{(pid=76395) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG cinder.image.image_utils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76395) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 19 19:40:06 devstack cinder-volume[76395]: INFO cinder.keymgr.migration [None req-dd61465a-046c-478a-bac9-04d5f1f3de43 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG cinder.volume.drivers.lvm [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Updating volume stats {{(pid=76395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:06 devstack sudo[77216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:40:06 devstack sudo[77216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:06 devstack sudo[77216]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:06 devstack sudo[77220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:40:06 devstack sudo[77220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:06 devstack sudo[77220]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:06 devstack sudo[77223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:06 devstack sudo[77223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:06 devstack sudo[77223]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:06 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:06 devstack sudo[77226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:40:06 devstack sudo[77226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:07 devstack sudo[77226]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG cinder.manager [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Notifying Schedulers of capabilities ... {{(pid=76395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:40:07 devstack cinder-volume[76395]: INFO cinder.volume.manager [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Driver initialization completed successfully.
Jul 19 19:40:07 devstack cinder-volume[76395]: INFO cinder.manager [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Initiating service 2 cleanup
Jul 19 19:40:07 devstack cinder-volume[76395]: INFO cinder.manager [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Service 2 cleanup completed.
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG cinder.service [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Creating RPC server for service cinder-volume {{(pid=76395) start /opt/stack/cinder/cinder/service.py:231}}
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG cinder.service [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76395) start /opt/stack/cinder/cinder/service.py:237}}
Jul 19 19:40:07 devstack cinder-volume[76395]: INFO cinder.volume.manager [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG cinder.volume.drivers.lvm [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Updating volume stats {{(pid=76395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:07 devstack sudo[77231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:40:07 devstack sudo[77231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:07 devstack sudo[77231]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:07 devstack sudo[77234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:40:07 devstack sudo[77234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:07 devstack sudo[77234]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:07 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:07 devstack sudo[77237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:40:07 devstack sudo[77237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:08 devstack sudo[77237]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:08 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:08 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:40:08 devstack sudo[77240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:40:08 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:40:08 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root
Jul 19 19:40:08 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:40:08 devstack cinder-volume[76395]: INFO cinder.volume.manager [None req-df6fa872-2a74-49f3-ba94-f44ee7c88ec2 None None] Driver post RPC initialization completed successfully.
Jul 19 19:40:10 devstack cinder-volume[76260]: DEBUG dbcounter [-] [76260] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:40:17 devstack cinder-volume[76395]: DEBUG dbcounter [-] [76395] Writing DB stats cinder:SELECT=3 {{(pid=76395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:40:18 devstack cinder-volume[76395]: DEBUG dbcounter [-] [76395] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:40:28 devstack cinder-volume[76395]: DEBUG oslo_service.periodic_task [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running periodic task VolumeManager._thread_info {{(pid=76395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:40:28 devstack cinder-volume[76395]: DEBUG cinder.volume.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] thread count: 6 {{(pid=76395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:40:28 devstack cinder-volume[76395]: DEBUG cinder.volume.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] thread info: [<_MainThread(MainThread, started 140481657532544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140481546285056)>, <Thread(Thread-3 (stat_writer), started daemon 140481544918592)>, <Thread(Rabbit-heartbeat, started daemon 140481543696448)>, <Thread(Thread-5 (_runner), started daemon 140481543798080)>, <Thread(Thread-7 (_runner), started daemon 140481543930880)>] {{(pid=76395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:41:28 devstack cinder-volume[76395]: DEBUG oslo_service.periodic_task [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:41:28 devstack cinder-volume[76395]: DEBUG cinder.volume.drivers.lvm [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Updating volume stats {{(pid=76395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 19 19:41:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:41:28 devstack sudo[79628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:41:28 devstack sudo[79628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:41:28 devstack sudo[79628]: pam_unix(sudo:session): session closed for user root
Jul 19 19:41:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:41:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:41:28 devstack sudo[79632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:41:28 devstack sudo[79632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:41:28 devstack sudo[79632]: pam_unix(sudo:session): session closed for user root
Jul 19 19:41:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:41:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:41:28 devstack sudo[79635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:41:28 devstack sudo[79635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:41:29 devstack sudo[79635]: pam_unix(sudo:session): session closed for user root
Jul 19 19:41:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:41:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:41:29 devstack sudo[79641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:41:29 devstack sudo[79641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:41:29 devstack sudo[79641]: pam_unix(sudo:session): session closed for user root
Jul 19 19:41:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:41:29 devstack cinder-volume[76395]: DEBUG cinder.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Notifying Schedulers of capabilities ... {{(pid=76395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:41:29 devstack cinder-volume[76395]: DEBUG oslo_service.periodic_task [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running periodic task VolumeManager._thread_info {{(pid=76395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:41:29 devstack cinder-volume[76395]: DEBUG cinder.volume.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] thread count: 6 {{(pid=76395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:41:29 devstack cinder-volume[76395]: DEBUG cinder.volume.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] thread info: [<_MainThread(MainThread, started 140481657532544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140481546285056)>, <Thread(Thread-3 (stat_writer), started daemon 140481544918592)>, <Thread(Rabbit-heartbeat, started daemon 140481543696448)>, <Thread(Thread-5 (_runner), started daemon 140481543798080)>, <Thread(Thread-7 (_runner), started daemon 140481543930880)>] {{(pid=76395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:42:18 devstack cinder-volume[76395]: DEBUG dbcounter [-] [76395] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:42:28 devstack cinder-volume[76395]: DEBUG oslo_service.periodic_task [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:42:28 devstack cinder-volume[76395]: DEBUG cinder.volume.drivers.lvm [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Updating volume stats {{(pid=76395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 19 19:42:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:42:28 devstack sudo[82820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:42:28 devstack sudo[82820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:42:28 devstack sudo[82820]: pam_unix(sudo:session): session closed for user root
Jul 19 19:42:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:42:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:42:28 devstack sudo[82824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:42:28 devstack sudo[82824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:42:28 devstack sudo[82824]: pam_unix(sudo:session): session closed for user root
Jul 19 19:42:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:42:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:42:28 devstack sudo[82843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:42:28 devstack sudo[82843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:42:29 devstack sudo[82843]: pam_unix(sudo:session): session closed for user root
Jul 19 19:42:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:42:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:42:29 devstack sudo[82847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:42:29 devstack sudo[82847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:42:29 devstack sudo[82847]: pam_unix(sudo:session): session closed for user root
Jul 19 19:42:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:42:29 devstack cinder-volume[76395]: DEBUG cinder.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Notifying Schedulers of capabilities ... {{(pid=76395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:42:29 devstack cinder-volume[76395]: DEBUG oslo_service.periodic_task [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running periodic task VolumeManager._thread_info {{(pid=76395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:42:29 devstack cinder-volume[76395]: DEBUG cinder.volume.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] thread count: 6 {{(pid=76395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:42:29 devstack cinder-volume[76395]: DEBUG cinder.volume.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] thread info: [<_MainThread(MainThread, started 140481657532544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140481546285056)>, <Thread(Thread-3 (stat_writer), started daemon 140481544918592)>, <Thread(Rabbit-heartbeat, started daemon 140481543696448)>, <Thread(Thread-5 (_runner), started daemon 140481543798080)>, <Thread(Thread-7 (_runner), started daemon 140481543930880)>] {{(pid=76395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:43:28 devstack cinder-volume[76395]: DEBUG oslo_service.periodic_task [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:43:28 devstack cinder-volume[76395]: DEBUG cinder.volume.drivers.lvm [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Updating volume stats {{(pid=76395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 19 19:43:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:43:28 devstack sudo[84826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:43:28 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:43:28 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root
Jul 19 19:43:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:43:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:43:28 devstack sudo[84829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:43:28 devstack sudo[84829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:43:28 devstack sudo[84829]: pam_unix(sudo:session): session closed for user root
Jul 19 19:43:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:43:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:43:28 devstack sudo[84832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:43:28 devstack sudo[84832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:43:29 devstack sudo[84832]: pam_unix(sudo:session): session closed for user root
Jul 19 19:43:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:43:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:43:29 devstack sudo[84835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:43:29 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:43:29 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root
Jul 19 19:43:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:43:29 devstack cinder-volume[76395]: DEBUG cinder.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Notifying Schedulers of capabilities ... {{(pid=76395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:44:18 devstack cinder-volume[76395]: DEBUG dbcounter [-] [76395] Writing DB stats cinder:SELECT=1 {{(pid=76395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:44:18 devstack cinder-volume[76395]: DEBUG dbcounter [-] [76395] Writing DB stats cinder:UPDATE=1 {{(pid=76395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:44:28 devstack cinder-volume[76395]: DEBUG oslo_service.periodic_task [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:44:28 devstack cinder-volume[76395]: DEBUG cinder.volume.drivers.lvm [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Updating volume stats {{(pid=76395) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 19 19:44:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:28 devstack sudo[86069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 19 19:44:28 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:44:28 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root
Jul 19 19:44:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:28 devstack sudo[86072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:44:28 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:44:28 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root
Jul 19 19:44:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:28 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:28 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 19 19:44:28 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:44:29 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Jul 19 19:44:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:29 devstack sudo[86079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 19 19:44:29 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:44:29 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root
Jul 19 19:44:29 devstack cinder-volume[76395]: DEBUG oslo_concurrency.processutils [None req-60b775d6-a439-4635-98e2-24720708d404 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76395) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:29 devstack cinder-volume[76395]: DEBUG cinder.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Notifying Schedulers of capabilities ... {{(pid=76395) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:44:29 devstack cinder-volume[76395]: DEBUG oslo_service.periodic_task [None req-60b775d6-a439-4635-98e2-24720708d404 None None] Running periodic task VolumeManager._thread_info {{(pid=76395) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:44:29 devstack cinder-volume[76395]: DEBUG cinder.volume.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] thread count: 6 {{(pid=76395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:44:29 devstack cinder-volume[76395]: DEBUG cinder.volume.manager [None req-60b775d6-a439-4635-98e2-24720708d404 None None] thread info: [<_MainThread(MainThread, started 140481657532544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140481546285056)>, <Thread(Thread-3 (stat_writer), started daemon 140481544918592)>, <Thread(Rabbit-heartbeat, started daemon 140481543696448)>, <Thread(Thread-5 (_runner), started daemon 140481543798080)>, <Thread(Thread-7 (_runner), started daemon 140481543930880)>] {{(pid=76395) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:44:43 devstack cinder-volume[76260]: INFO oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Caught SIGTERM, stopping children
Jul 19 19:44:43 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Acquiring lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 19 19:44:43 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Acquired lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 19 19:44:43 devstack cinder-volume[76260]: DEBUG oslo_concurrency.lockutils [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Releasing lock "singleton_lock" {{(pid=76260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 19 19:44:43 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Stop services. {{(pid=76260) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 19 19:44:43 devstack cinder-volume[76260]: DEBUG oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Killing children. {{(pid=76260) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 19 19:44:43 devstack cinder-volume[76260]: INFO oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Waiting on 1 children to exit
Jul 19 19:44:47 devstack cinder-volume[76395]: DEBUG oslo_concurrency.lockutils [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Acquiring lock "singleton_lock" {{(pid=76395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 19 19:44:47 devstack cinder-volume[76395]: DEBUG oslo_concurrency.lockutils [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Acquired lock "singleton_lock" {{(pid=76395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 19 19:44:47 devstack cinder-volume[76395]: DEBUG oslo_concurrency.lockutils [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Releasing lock "singleton_lock" {{(pid=76395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 19 19:44:47 devstack cinder-volume[76395]: WARNING amqp [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 19 19:44:47 devstack cinder-volume[76395]: WARNING amqp [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 19 19:44:47 devstack cinder-volume[76260]: INFO oslo_service.backend._eventlet.service [None req-2f245c1a-a19d-41b9-8ce7-fcd8ff13f960 None None] Child 76395 exited with status 0
Jul 19 19:44:47 devstack cinder-volume[86559]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 19 19:44:47 devstack cinder-volume[86559]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 19 19:44:47 devstack cinder-volume[86559]: we strongly recommend against using it for new projects.
Jul 19 19:44:47 devstack cinder-volume[86559]: If you are already using Eventlet, we recommend migrating to a different
Jul 19 19:44:47 devstack cinder-volume[86559]: framework.  For more detail see
Jul 19 19:44:47 devstack cinder-volume[86559]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 19 19:44:47 devstack cinder-volume[86559]:   import eventlet  # noqa
Jul 19 19:44:49 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 19 19:44:49 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 19 19:44:49 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 19 19:44:50 devstack cinder-volume[86559]: INFO dbcounter [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Registered counter for database cinder
Jul 19 19:44:50 devstack cinder-volume[86559]: DEBUG oslo_db.sqlalchemy.engines [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86559) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:44:50 devstack cinder-volume[86559]: DEBUG dbcounter [-] [86559] Writer thread running {{(pid=86559) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 19 19:44:51 devstack cinder-volume[86559]: INFO cinder.rpc [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 19 19:44:51 devstack cinder-volume[86559]: INFO cinder.rpc [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_db.sqlalchemy.engines [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86559) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:44:51 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Determined volume DB was empty at startup.
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG cinder.volume.manager [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86559) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 19 19:44:51 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 19 19:44:51 devstack cinder-volume[86559]: WARNING stevedore.named [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 19 19:44:51 devstack cinder-volume[86559]: WARNING castellan.key_manager [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 19 19:44:51 devstack cinder-volume[86559]: WARNING cinder.keymgr.conf_key_mgr [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 19 19:44:51 devstack cinder-volume[86559]: INFO cinder.volume.manager [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_db.sqlalchemy.engines [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86559) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:44:51 devstack cinder-volume[86559]: INFO oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Starting 1 workers
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Started child 86830 {{(pid=86559) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Full set of CONF: {{(pid=86559) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] ******************************************************************************** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Configuration options gathered from: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] ================================================================================ {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] allow_availability_zone_fallback = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] allow_compression_on_image_upload = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] allowed_direct_url_schemes     = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] api_rate_limit                 = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] auth_strategy                  = keystone {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_availability_zone      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_host                   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_name                   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86830]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_stats_polling_interval = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backup_api_class               = cinder.backup.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backup_name_template           = backup-%s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backup_use_same_host           = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backup_use_temp_snapshot       = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] chap_password                  = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] chap_username                  =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_internal_tenant_project_id = ef02ebb4ee194506b17fb6d9ab9298b3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_internal_tenant_user_id = cbbb5d80ff39479b9ca901e0b62944de {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cluster                        = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] compression_format             = gzip {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] config_dir                     = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] config_source                  = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] control_exchange               = openstack {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] debug                          = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] default_availability_zone      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] default_group_type             = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] default_volume_type            = QuobyteHD {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] disk_geometry                  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] driver_client_cert             = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] driver_client_cert_key         = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] driver_data_namespace          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] driver_ssl_cert_path           = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] driver_ssl_cert_verify         = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] driver_use_ssl                 = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] enable_new_services            = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] enable_unsupported_driver      = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] enforce_multipath_for_image_xfer = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] filter_function                = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_api_insecure            = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_api_servers             = ['http://192.168.122.70/image'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_api_ssl_compression     = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_ca_certificates_file    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_certfile                = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_keyfile                 = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_num_retries             = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance_request_timeout         = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] goodness_function              = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] graceful_shutdown_timeout      = 5 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] group_api_class                = cinder.group.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] host                           = devstack {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_compress_on_upload       = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_conversion_address_space_limit = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_conversion_cpu_limit     = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_conversion_disable       = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_upload_use_cinder_backend = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_upload_use_internal_tenant = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_volume_cache_enabled     = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_volume_cache_max_count   = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] image_volume_cache_max_size_gb = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] init_host_max_objects_retrieval = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] iscsi_target_flags             =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] iscsi_write_cache              = on {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] iser_helper                    = tgtadm {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] iser_ip_address                = 192.168.122.70 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] iser_port                      = 3260 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_color                      = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_config_append              = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_dir                        = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_file                       = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_options                    = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_rotate_interval            = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_rotate_interval_type       = days {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] log_rotation_type              = none {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] max_age                        = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] max_logfile_count              = 30 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] max_logfile_size_mb            = 200 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] max_over_subscription_ratio    = 20.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] message_reap_interval          = 86400 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] message_ttl                    = 2592000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] migration_create_volume_timeout_secs = 300 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] monkey_patch                   = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] monkey_patch_modules           = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] my_ip                          = 192.168.122.70 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] no_snapshot_gb_quota           = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] num_iser_scan_tries            = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] num_shell_tries                = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] num_volume_device_scan_tries   = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] nvmeof_conn_info_version       = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] nvmet_ns_id                    = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] nvmet_port_id                  = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] osapi_max_limit                = 1000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] osapi_volume_ext_list          = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] osapi_volume_listen_port       = 8776 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] osapi_volume_use_ssl           = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] osapi_volume_workers           = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] per_volume_size_limit          = -1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] periodic_fuzzy_delay           = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] periodic_interval              = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] public_endpoint                = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] publish_errors                 = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] quota_backup_gigabytes         = 1000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] quota_backups                  = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] quota_gigabytes                = 1000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] quota_groups                   = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] quota_snapshots                = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] quota_volumes                  = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] rate_limit_burst               = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] rate_limit_except_level        = CRITICAL {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] rate_limit_interval            = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] reinit_driver_count            = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] replication_device             = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] report_discard_supported       = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] report_interval                = 120 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] reservation_clean_interval     = 86400 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] reservation_expire             = 86400 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] reserved_image_namespaces      = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] reserved_percentage            = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] rpc_response_timeout           = 120 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] run_external_periodic_tasks    = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] scst_target_driver             = iscsi {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] scst_target_iqn_name           = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_down_time              = 720 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] shell_completion               = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] snapshot_name_template         = snapshot-%s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] split_loggers                  = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] state_path                     = /opt/stack/data/cinder {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] storage_availability_zone      = nova {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] storage_protocol               = iSCSI {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] syslog_log_facility            = LOG_USER {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] target_helper                  = lioadm {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] target_ip_address              = 192.168.122.70 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] target_port                    = 3260 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] target_protocol                = iscsi {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] target_secondary_ip_addresses  = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] trace_flags                    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] transport_url                  = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] until_refresh                  = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] use_chap_auth                  = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] use_default_quota_class        = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] use_journal                    = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] use_json                       = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] use_multipath_for_image_xfer   = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] use_stderr                     = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] use_syslog                     = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] verify_glance_signatures       = enabled {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_api_class               = cinder.volume.api.API {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_backend_name            = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_clear                   = zero {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_clear_ionice            = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_clear_size              = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_copy_bps_limit          = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_dd_blocksize            = 1M {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_name_template           = volume-%s {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_service_inithost_offload = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volume_usage_audit_period      = month {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] zoning_mode                    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_concurrency.disable_process_locking = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.auth_section = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.auth_type   = password {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.auth_version = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.cache       = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.certfile    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86830]: INFO cinder.volume.manager [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Starting volume driver QuobyteDriver (1.2)
Jul 19 19:44:51 devstack cinder-volume[86830]: DEBUG cinder.volume.drivers.remotefs [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86830) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.include_service_catalog = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.insecure    = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.interface   = public {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.keyfile     = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_password =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcache_username =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.region_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.service_type = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.70/identity {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.backend                  = dogpile.cache.null {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.backend_argument         = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.backend_expiration_time  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.config_prefix            = cache.oslo {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.debug_cache_backend      = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.enable_retry_client      = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.enable_socket_keepalive  = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.enabled                  = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.expiration_time          = 600 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.hashclient_retry_attempts = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.memcache_dead_retry      = 300 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.memcache_sasl_enabled    = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.password                 = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.proxies                  = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.redis_db                 = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.redis_server             = localhost:6379 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.retry_attempts           = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.retry_delay              = 0.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.socket_keepalive_count   = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.socket_keepalive_idle    = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.socket_keepalive_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.socket_timeout           = 1.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.tls_allowed_ciphers      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.tls_cafile               = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.tls_certfile             = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.tls_enabled              = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.tls_keyfile              = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cache.username                 = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] coordination.backend_url       = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.asyncio_connection    = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.asyncio_slave_connection = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.backend               = sqlalchemy {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.connection            = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.connection_debug      = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.connection_parameters =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.connection_recycle_time = 3600 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.connection_trace      = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.db_inc_retry_interval = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.db_max_retries        = 20 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.db_max_retry_interval = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.db_retry_interval     = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.max_overflow          = 50 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.max_pool_size         = 5 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.max_retries           = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.mysql_wsrep_sync_wait = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.pool_timeout          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.retry_interval        = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.slave_connection      = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.sqlite_synchronous    = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.synchronous_reader    = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] database.use_db_reconnect      = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.connection_string     = messaging:// {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.enabled               = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.es_doc_type           = notification {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.es_scroll_size        = 10000 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.es_scroll_time        = 2m {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.filter_error_trace    = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.hmac_keys             = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.sentinel_service_name = mymaster {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.socket_timeout        = 0.1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.trace_requests        = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler.trace_sqlalchemy      = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler_jaeger.process_tags   = {} {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler_jaeger.service_name_prefix = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] profiler_otlp.service_name_prefix = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.enforce_new_defaults = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.policy_default_rule = default {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] privsep_osbrick.group          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] privsep_osbrick.helper_command = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] privsep_osbrick.user           = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_sys_admin.group         = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_sys_admin.helper_command = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] cinder_sys_admin.user          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.auth_section      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.auth_type         = password {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.cafile            = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.certfile          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.collect_timing    = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.insecure          = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.keyfile           = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.send_service_user_token = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.split_loggers     = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] service_user.timeout           = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.auth_section            = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.auth_type               = password {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.certfile                = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.collect_timing          = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.insecure                = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.keyfile                 = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.region_name             = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.split_loggers           = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] glance.timeout                 = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.backend_availability_zone = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.chap_password = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.chap_username =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.disk_geometry = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.driver_client_cert = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.driver_client_cert_key = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.driver_data_namespace = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.driver_use_ssl = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.extra_capabilities = {} {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.filter_function = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.goodness_function = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.iscsi_target_flags =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.iscsi_write_cache = on {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.iser_ip_address = 192.168.122.70 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.iser_port     = 3260 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_host      =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_login     = admin {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_mount_options = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_password  = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_private_key =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_share_path =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.num_shell_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.quobyte_volume_url = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.replication_device = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.report_discard_supported = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.reserved_percentage = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.target_helper = tgtadm {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.target_ip_address = 192.168.122.70 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.target_port   = 3260 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.target_protocol = iscsi {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.trace_flags   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.unique_fqdn_network = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.use_chap_auth = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volume_backend_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volume_clear  = zero {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volume_clear_ionice = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volume_clear_size = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_reports.file_event_handler = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_reports.log_dir           = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.backend_availability_zone = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.backend_host         = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.chap_password        = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.chap_username        = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.disk_geometry        = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.driver_client_cert   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.driver_data_namespace = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.extra_capabilities   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.filter_function      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.goodness_function    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.iser_helper          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.iser_ip_address      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.iser_port            = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_host             = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_login            = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_mount_options    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_password         = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_private_key      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_share_path       = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.num_shell_tries      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.replication_device   = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.report_discard_supported = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.reserved_percentage  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.scst_target_driver   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.storage_protocol     = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.target_helper        = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.target_ip_address    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.target_port          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.target_prefix        = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.target_protocol      = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.trace_flags          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.use_chap_auth        = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volume_clear         = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volume_clear_size    = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] QuobyteHD.volumes_dir          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_notifications.driver = [] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_notifications.retry = -1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86830]: DEBUG cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86830) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 19 19:44:51 devstack cinder-volume[86830]: WARNING cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 19 19:44:51 devstack cinder-volume[86830]: WARNING cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] key_manager.fixed_key          = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Running cmd (subprocess): mount.quobyte {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.barbican_api_version  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.barbican_endpoint     = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.barbican_endpoint_type = public {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.barbican_region_name  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.cafile                = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.certfile              = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.collect_timing        = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.insecure              = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.keyfile               = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.number_of_retries     = 60 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.retry_delay           = 1 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.send_service_user_token = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.split_loggers         = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.timeout               = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.verify_ssl            = True {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican.verify_ssl_path       = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.auth_section = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.auth_type = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.cafile   = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.certfile = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.collect_timing = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.insecure = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.keyfile  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.split_loggers = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] barbican_service_user.timeout  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.approle_role_id          = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.approle_secret_id        = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.auth_method              = approle {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.auth_path                = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.kv_mountpoint            = secret {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.kv_path                  = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.kv_version               = 2 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.namespace                = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.root_token_id            = **** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack quobyte-client[86842]: Reading configuration file: /etc/quobyte/client.cfg
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.ssl_ca_crt_file          = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.timeout                  = 60.0 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.token_file               = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.token_role               = None {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.use_ssl                  = False {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:44:51 devstack quobyte-client[86842]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 19 19:44:51 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] ******************************************************************************** {{(pid=86559) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 19 19:44:51 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] CMD "mount.quobyte" returned: 1 in 0.089s {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:51 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:44:51 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:44:51 devstack cinder-volume[86830]: DEBUG cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=86830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:44:51 devstack cinder-volume[86830]: INFO cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 ...
Jul 19 19:44:51 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af -c /etc/quobyte/client-cinder.cfg {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:51 devstack sudo[86843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af -c /etc/quobyte/client-cinder.cfg
Jul 19 19:44:51 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:44:52 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.398s {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:52 devstack cinder-volume[86830]: INFO cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 succeeded
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=86830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.414s {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:52 devstack sudo[86920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:44:52 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:44:52 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.263s {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:52 devstack cinder-volume[86830]: INFO cinder.volume.driver [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Driver hasn't implemented _init_vendor_properties()
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.volume.driver [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86830) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_db.sqlalchemy.engines [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG dbcounter [-] [86830] Writer thread running {{(pid=86830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.db.api [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Building query based on filter {{(pid=86830) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.image.image_utils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86830) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 19 19:44:52 devstack cinder-volume[86830]: INFO cinder.keymgr.migration [None req-c3dab48f-7136-4b70-8bf6-f865dd265819 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=86830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=86830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:52 devstack sudo[86931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:44:52 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:44:52 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.251s {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.manager [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Notifying Schedulers of capabilities ... {{(pid=86830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:44:52 devstack cinder-volume[86830]: INFO cinder.volume.manager [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Driver initialization completed successfully.
Jul 19 19:44:52 devstack cinder-volume[86830]: INFO cinder.manager [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Initiating service 3 cleanup
Jul 19 19:44:52 devstack cinder-volume[86830]: INFO cinder.manager [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Service 3 cleanup completed.
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.service [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Creating RPC server for service cinder-volume {{(pid=86830) start /opt/stack/cinder/cinder/service.py:231}}
Jul 19 19:44:52 devstack cinder-volume[86830]: DEBUG cinder.service [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86830) start /opt/stack/cinder/cinder/service.py:237}}
Jul 19 19:44:53 devstack cinder-volume[86830]: INFO cinder.volume.manager [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 19 19:44:53 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:44:53 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:44:53 devstack cinder-volume[86830]: DEBUG cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=86830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:44:53 devstack cinder-volume[86830]: DEBUG cinder.volume.drivers.quobyte [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=86830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:44:53 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:44:53 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:44:53 devstack sudo[86943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:44:53 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:44:53 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root
Jul 19 19:44:53 devstack cinder-volume[86830]: DEBUG oslo_concurrency.processutils [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.258s {{(pid=86830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:44:53 devstack cinder-volume[86830]: INFO cinder.volume.manager [None req-9ef560e4-5a8b-47d9-be5d-2bb330be546b None None] Driver post RPC initialization completed successfully.
Jul 19 19:44:56 devstack cinder-volume[86559]: INFO oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Caught SIGTERM, stopping children
Jul 19 19:44:56 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Acquiring lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 19 19:44:56 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Acquired lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 19 19:44:56 devstack cinder-volume[86559]: DEBUG oslo_concurrency.lockutils [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Releasing lock "singleton_lock" {{(pid=86559) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 19 19:44:56 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Stop services. {{(pid=86559) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 19 19:44:56 devstack cinder-volume[86559]: DEBUG oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Killing children. {{(pid=86559) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 19 19:44:56 devstack cinder-volume[86559]: INFO oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Waiting on 1 children to exit
Jul 19 19:44:57 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Acquiring lock "singleton_lock" {{(pid=86830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 19 19:44:57 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Acquired lock "singleton_lock" {{(pid=86830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 19 19:44:57 devstack cinder-volume[86830]: DEBUG oslo_concurrency.lockutils [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Releasing lock "singleton_lock" {{(pid=86830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 19 19:44:57 devstack cinder-volume[86830]: WARNING amqp [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 19 19:44:57 devstack cinder-volume[86830]: WARNING amqp [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 19 19:44:57 devstack cinder-volume[86559]: INFO oslo_service.backend._eventlet.service [None req-f089fc18-c92f-4988-bd0d-b1286a744370 None None] Child 86830 exited with status 0
Jul 19 19:44:57 devstack cinder-volume[87188]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 19 19:44:57 devstack cinder-volume[87188]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 19 19:44:57 devstack cinder-volume[87188]: we strongly recommend against using it for new projects.
Jul 19 19:44:57 devstack cinder-volume[87188]: If you are already using Eventlet, we recommend migrating to a different
Jul 19 19:44:57 devstack cinder-volume[87188]: framework.  For more detail see
Jul 19 19:44:57 devstack cinder-volume[87188]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 19 19:44:57 devstack cinder-volume[87188]:   import eventlet  # noqa
Jul 19 19:44:59 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 19 19:44:59 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 19 19:44:59 devstack cinder-volume[87188]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 19 19:45:00 devstack cinder-volume[87188]: INFO dbcounter [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Registered counter for database cinder
Jul 19 19:45:00 devstack cinder-volume[87188]: DEBUG oslo_db.sqlalchemy.engines [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG dbcounter [-] [87188] Writer thread running {{(pid=87188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 19 19:45:01 devstack cinder-volume[87188]: INFO cinder.rpc [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 19 19:45:01 devstack cinder-volume[87188]: INFO cinder.rpc [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_db.sqlalchemy.engines [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:45:01 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Determined volume DB was empty at startup.
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG cinder.volume.manager [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87188) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 19 19:45:01 devstack cinder-volume[87188]: WARNING stevedore.named [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 19 19:45:01 devstack cinder-volume[87188]: WARNING castellan.key_manager [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 19 19:45:01 devstack cinder-volume[87188]: WARNING cinder.keymgr.conf_key_mgr [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 19 19:45:01 devstack cinder-volume[87188]: INFO cinder.volume.manager [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_db.sqlalchemy.engines [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:45:01 devstack cinder-volume[87188]: INFO oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Starting 1 workers
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Started child 87353 {{(pid=87188) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Full set of CONF: {{(pid=87188) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] ******************************************************************************** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] Configuration options gathered from: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] ================================================================================ {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] allow_availability_zone_fallback = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] allow_compression_on_image_upload = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] allowed_direct_url_schemes     = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] api_rate_limit                 = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] auth_strategy                  = keystone {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87353]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_availability_zone      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_host                   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_name                   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_stats_polling_interval = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backup_api_class               = cinder.backup.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backup_name_template           = backup-%s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backup_use_same_host           = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backup_use_temp_snapshot       = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] chap_password                  = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] chap_username                  =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_internal_tenant_project_id = ef02ebb4ee194506b17fb6d9ab9298b3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_internal_tenant_user_id = cbbb5d80ff39479b9ca901e0b62944de {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cluster                        = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] compression_format             = gzip {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] config_dir                     = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] config_source                  = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] control_exchange               = openstack {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] debug                          = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] default_availability_zone      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] default_group_type             = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] default_volume_type            = QuobyteHD {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] disk_geometry                  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] driver_client_cert             = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] driver_client_cert_key         = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] driver_data_namespace          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] driver_ssl_cert_path           = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] driver_ssl_cert_verify         = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] driver_use_ssl                 = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] enable_new_services            = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:01 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] enable_unsupported_driver      = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] enforce_multipath_for_image_xfer = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] filter_function                = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_api_insecure            = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_api_servers             = ['http://192.168.122.70/image'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_api_ssl_compression     = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_ca_certificates_file    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_certfile                = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_keyfile                 = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_num_retries             = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance_request_timeout         = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] goodness_function              = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] graceful_shutdown_timeout      = 5 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] group_api_class                = cinder.group.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] host                           = devstack {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_compress_on_upload       = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_conversion_address_space_limit = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_conversion_cpu_limit     = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_conversion_disable       = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_upload_use_cinder_backend = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_upload_use_internal_tenant = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_volume_cache_enabled     = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_volume_cache_max_count   = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] image_volume_cache_max_size_gb = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] init_host_max_objects_retrieval = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] iscsi_target_flags             =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] iscsi_write_cache              = on {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] iser_helper                    = tgtadm {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] iser_ip_address                = 192.168.122.70 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] iser_port                      = 3260 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Starting volume driver QuobyteDriver (1.2)
Jul 19 19:45:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87353) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_color                      = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_config_append              = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_dir                        = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_file                       = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_options                    = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack quobyte-client[87391]: Reading configuration file: /etc/quobyte/client.cfg
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_rotate_interval            = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_rotate_interval_type       = days {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] log_rotation_type              = none {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack quobyte-client[87391]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] max_age                        = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] max_logfile_count              = 30 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] max_logfile_size_mb            = 200 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] max_over_subscription_ratio    = 20.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] message_reap_interval          = 86400 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] message_ttl                    = 2592000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] migration_create_volume_timeout_secs = 300 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] monkey_patch                   = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] monkey_patch_modules           = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] my_ip                          = 192.168.122.70 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] no_snapshot_gb_quota           = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] num_iser_scan_tries            = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] num_shell_tries                = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] num_volume_device_scan_tries   = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] nvmeof_conn_info_version       = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] nvmet_ns_id                    = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] nvmet_port_id                  = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] osapi_max_limit                = 1000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] osapi_volume_ext_list          = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] osapi_volume_listen_port       = 8776 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] osapi_volume_use_ssl           = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] osapi_volume_workers           = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] per_volume_size_limit          = -1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] periodic_fuzzy_delay           = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] periodic_interval              = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] public_endpoint                = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] publish_errors                 = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] quota_backup_gigabytes         = 1000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] quota_backups                  = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] quota_gigabytes                = 1000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] quota_groups                   = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] quota_snapshots                = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] quota_volumes                  = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] rate_limit_burst               = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] rate_limit_except_level        = CRITICAL {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] rate_limit_interval            = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] reinit_driver_count            = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] replication_device             = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] report_discard_supported       = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] report_interval                = 120 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] reservation_clean_interval     = 86400 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] reservation_expire             = 86400 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] reserved_image_namespaces      = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] reserved_percentage            = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] rpc_response_timeout           = 120 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] run_external_periodic_tasks    = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] scst_target_driver             = iscsi {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] scst_target_iqn_name           = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_down_time              = 720 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] shell_completion               = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] snapshot_name_template         = snapshot-%s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] split_loggers                  = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] state_path                     = /opt/stack/data/cinder {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] storage_availability_zone      = nova {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] storage_protocol               = iSCSI {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] syslog_log_facility            = LOG_USER {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] target_helper                  = lioadm {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] target_ip_address              = 192.168.122.70 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] target_port                    = 3260 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] target_protocol                = iscsi {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] target_secondary_ip_addresses  = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] trace_flags                    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] transport_url                  = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] until_refresh                  = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] use_chap_auth                  = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] use_default_quota_class        = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] use_journal                    = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] use_json                       = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] use_multipath_for_image_xfer   = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] use_stderr                     = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] use_syslog                     = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] verify_glance_signatures       = enabled {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_api_class               = cinder.volume.api.API {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_backend_name            = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_clear                   = zero {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_clear_ionice            = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_clear_size              = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_copy_bps_limit          = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_dd_blocksize            = 1M {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_name_template           = volume-%s {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_service_inithost_offload = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volume_usage_audit_period      = month {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] zoning_mode                    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_concurrency.disable_process_locking = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.auth_section = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.auth_type   = password {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.auth_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.cache       = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.certfile    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.include_service_catalog = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.insecure    = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.interface   = public {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.keyfile     = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_password =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcache_username =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.region_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.service_type = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.70/identity {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.backend                  = dogpile.cache.null {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.backend_argument         = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.backend_expiration_time  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.config_prefix            = cache.oslo {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.debug_cache_backend      = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.enable_retry_client      = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.enable_socket_keepalive  = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.enabled                  = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.expiration_time          = 600 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.hashclient_retry_attempts = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.memcache_dead_retry      = 300 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.memcache_sasl_enabled    = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.password                 = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.proxies                  = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.redis_db                 = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.redis_server             = localhost:6379 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.retry_attempts           = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.retry_delay              = 0.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.socket_keepalive_count   = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.socket_keepalive_idle    = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.socket_keepalive_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.socket_timeout           = 1.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.tls_allowed_ciphers      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.tls_cafile               = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.tls_certfile             = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.tls_enabled              = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.tls_keyfile              = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cache.username                 = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] coordination.backend_url       = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.asyncio_connection    = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.asyncio_slave_connection = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.backend               = sqlalchemy {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.connection            = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.connection_debug      = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.connection_parameters =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.connection_recycle_time = 3600 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.connection_trace      = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.db_inc_retry_interval = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.db_max_retries        = 20 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.db_max_retry_interval = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.db_retry_interval     = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.max_overflow          = 50 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.max_pool_size         = 5 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.max_retries           = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.mysql_wsrep_sync_wait = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.pool_timeout          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.retry_interval        = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.slave_connection      = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.sqlite_synchronous    = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.synchronous_reader    = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] database.use_db_reconnect      = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.connection_string     = messaging:// {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.enabled               = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.es_doc_type           = notification {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.es_scroll_size        = 10000 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.es_scroll_time        = 2m {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.filter_error_trace    = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.hmac_keys             = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.sentinel_service_name = mymaster {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.socket_timeout        = 0.1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.trace_requests        = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler.trace_sqlalchemy      = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler_jaeger.process_tags   = {} {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler_jaeger.service_name_prefix = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] profiler_otlp.service_name_prefix = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.enforce_new_defaults = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.policy_default_rule = default {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] privsep_osbrick.group          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] privsep_osbrick.helper_command = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] privsep_osbrick.user           = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_sys_admin.group         = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_sys_admin.helper_command = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] cinder_sys_admin.user          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.auth_section      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.auth_type         = password {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.cafile            = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.certfile          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.collect_timing    = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.insecure          = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.keyfile           = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.send_service_user_token = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.split_loggers     = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] service_user.timeout           = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.auth_section            = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.auth_type               = password {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.certfile                = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.collect_timing          = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.insecure                = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.keyfile                 = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.region_name             = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.split_loggers           = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] glance.timeout                 = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.backend_availability_zone = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.chap_password = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.chap_username =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.disk_geometry = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.driver_client_cert = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.driver_client_cert_key = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.driver_data_namespace = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.driver_use_ssl = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.extra_capabilities = {} {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.filter_function = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.goodness_function = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.iscsi_target_flags =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.iscsi_write_cache = on {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.iser_ip_address = 192.168.122.70 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.iser_port     = 3260 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_host      =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_login     = admin {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_mount_options = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_password  = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_private_key =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_share_path =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.num_shell_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.quobyte_volume_url = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.replication_device = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.report_discard_supported = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.reserved_percentage = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.target_helper = tgtadm {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.target_ip_address = 192.168.122.70 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.target_port   = 3260 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.target_protocol = iscsi {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.trace_flags   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.unique_fqdn_network = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.use_chap_auth = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volume_backend_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volume_clear  = zero {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volume_clear_ionice = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volume_clear_size = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_reports.file_event_handler = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_reports.log_dir           = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.backend_availability_zone = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.backend_host         = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.chap_password        = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.chap_username        = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.disk_geometry        = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.driver_client_cert   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.driver_data_namespace = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.extra_capabilities   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.filter_function      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.goodness_function    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.iser_helper          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.iser_ip_address      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.iser_port            = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_host             = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_login            = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_mount_options    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_password         = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_private_key      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_share_path       = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.num_shell_tries      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.replication_device   = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.report_discard_supported = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.reserved_percentage  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.scst_target_driver   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.storage_protocol     = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.target_helper        = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.target_ip_address    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.target_port          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.target_prefix        = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.target_protocol      = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.trace_flags          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.use_chap_auth        = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volume_clear         = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volume_clear_size    = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] QuobyteHD.volumes_dir          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_notifications.driver = [] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_notifications.retry = -1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] key_manager.fixed_key          = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.barbican_api_version  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.barbican_endpoint     = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.barbican_endpoint_type = public {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.barbican_region_name  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.cafile                = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.certfile              = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.collect_timing        = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.insecure              = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.keyfile               = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.number_of_retries     = 60 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.retry_delay           = 1 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:02 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.send_service_user_token = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87353) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 19 19:45:03 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 19 19:45:03 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.split_loggers         = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.timeout               = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.verify_ssl            = True {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican.verify_ssl_path       = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.auth_section = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.auth_type = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.cafile   = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.certfile = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.collect_timing = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.insecure = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.keyfile  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.split_loggers = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] barbican_service_user.timeout  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.approle_role_id          = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.approle_secret_id        = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.auth_method              = approle {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.auth_path                = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.kv_mountpoint            = secret {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Running cmd (subprocess): mount.quobyte {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.kv_path                  = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.kv_version               = 2 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.namespace                = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.root_token_id            = **** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.ssl_ca_crt_file          = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.timeout                  = 60.0 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.token_file               = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.token_role               = None {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.use_ssl                  = False {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 19 19:45:03 devstack cinder-volume[87188]: DEBUG oslo_service.backend._eventlet.service [None req-1f612790-aae6-4e20-b2ac-d2516c4e5f66 None None] ******************************************************************************** {{(pid=87188) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.455s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:45:03 devstack cinder-volume[87353]: INFO cinder.volume.driver [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Driver hasn't implemented _init_vendor_properties()
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.volume.driver [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87353) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_db.sqlalchemy.engines [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87353) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writer thread running {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.db.api [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Building query based on filter {{(pid=87353) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87353) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:45:03 devstack cinder-volume[87353]: INFO cinder.keymgr.migration [None req-73021792-8708-42ec-91d3-4aa7fb4a95cf None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 19 19:45:03 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.356s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:45:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Driver initialization completed successfully.
Jul 19 19:45:03 devstack cinder-volume[87353]: INFO cinder.manager [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Initiating service 3 cleanup
Jul 19 19:45:03 devstack cinder-volume[87353]: INFO cinder.manager [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Service 3 cleanup completed.
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.service [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Creating RPC server for service cinder-volume {{(pid=87353) start /opt/stack/cinder/cinder/service.py:231}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.service [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87353) start /opt/stack/cinder/cinder/service.py:237}}
Jul 19 19:45:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:45:03 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:45:03 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:45:03 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Jul 19 19:45:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.322s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:45:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b3c9178c-1042-41d3-b93c-dbce03d198ce None None] Driver post RPC initialization completed successfully.
Jul 19 19:45:11 devstack cinder-volume[87188]: DEBUG dbcounter [-] [87188] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:45:13 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:45:13 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=3 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:45:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:45:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 6 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:45:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Flow 'volume_create_manager' (6f362d41-fed2-4f7d-9a77-56a9f09adbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974d8bc4-fa99-4713-97e1-6484ae7e3684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974d8bc4-fa99-4713-97e1-6484ae7e3684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2130352681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6411cb47-5797-41d9-b010-a20babcfa69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a64a6d2a0443d289f028caab96c801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:46:04Z,use_quota=True,user_id='c00a37df73984057bf8e144b9864e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902476fc-3bc5-47a9-9def-52be12c9f632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902476fc-3bc5-47a9-9def-52be12c9f632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be3a41a-2e82-4426-a305-cc6519a9916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be3a41a-2e82-4426-a305-cc6519a9916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6411cb47-5797-41d9-b010-a20babcfa69e', 'volume_name': 'volume-6411cb47-5797-41d9-b010-a20babcfa69e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7532c8c3-a69a-44e3-98fe-7008052fee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7532c8c3-a69a-44e3-98fe-7008052fee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4622859b-f1ba-4bc8-9de2-ca204b78e861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:04 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Volume 6411cb47-5797-41d9-b010-a20babcfa69e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6411cb47-5797-41d9-b010-a20babcfa69e', 'volume_size': 1}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2130352681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6411cb47-5797-41d9-b010-a20babcfa69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a64a6d2a0443d289f028caab96c801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:46:04Z,use_quota=True,user_id='c00a37df73984057bf8e144b9864e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Creating volume 6411cb47-5797-41d9-b010-a20babcfa69e {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:46:04 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:46:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:04 devstack sudo[87903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e 1073741824
Jul 19 19:46:04 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Flow 'volume_create_manager' (133ef6c5-7f0d-40f9-b788-9d7809163f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dd30f7-eac0-4b76-a86f-7d8107101115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dd30f7-eac0-4b76-a86f-7d8107101115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1627677646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c44592773248c28458b4dd8c1891f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:46:06Z,use_quota=True,user_id='b59ea420d0604364a46288439c8c1f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07390ab-fb62-40a1-ab39-6e2582eb2d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07390ab-fb62-40a1-ab39-6e2582eb2d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e080d57-82b6-4de5-a873-15d33278b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e080d57-82b6-4de5-a873-15d33278b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e', 'volume_name': 'volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6412519c-821c-452d-8db9-07b25abe24c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6412519c-821c-452d-8db9-07b25abe24c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:05 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5c1a77-9c78-486e-ba91-5816eb508559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:05 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Volume 3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e', 'volume_size': 1}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e 1073741824" returned: 0 in 1.252s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:05 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e
Jul 19 19:46:05 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:06 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e" returned: 0 in 0.810s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1627677646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c44592773248c28458b4dd8c1891f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:46:06Z,use_quota=True,user_id='b59ea420d0604364a46288439c8c1f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Creating volume 3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:46:06 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4622859b-f1ba-4bc8-9de2-ca204b78e861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6411cb47-5797-41d9-b010-a20babcfa69e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bb0098-947f-471e-8f57-099d7d37a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:06 devstack sudo[88225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e 1073741824
Jul 19 19:46:06 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:06 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Volume volume-6411cb47-5797-41d9-b010-a20babcfa69e (6411cb47-5797-41d9-b010-a20babcfa69e): created successfully
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bb0098-947f-471e-8f57-099d7d37a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Flow 'volume_create_manager' (6f362d41-fed2-4f7d-9a77-56a9f09adbfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:46:06 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2df2267b-6d84-4578-93aa-a56277487e26 tempest-TaggedAttachmentsTest-385267696 None] Created volume successfully.
Jul 19 19:46:07 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e 1073741824" returned: 0 in 1.118s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:08 devstack sudo[88251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e
Jul 19 19:46:08 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:08 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e" returned: 0 in 0.499s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:46:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5c1a77-9c78-486e-ba91-5816eb508559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22541d2-ae00-46f6-b533-412ab184a181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:08 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Volume volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e (3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e): created successfully
Jul 19 19:46:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22541d2-ae00-46f6-b533-412ab184a181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Flow 'volume_create_manager' (133ef6c5-7f0d-40f9-b788-9d7809163f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:46:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4b198c1b-b757-4cc9-bad0-4ca604a2b9b1 tempest-DeleteServersTestJSON-1941373802 None] Created volume successfully.
Jul 19 19:46:14 devstack cinder-volume[87353]: WARNING py.warnings [req-82bfd410-a665-4950-8137-c838780e016e req-8c3e772e-0704-4001-b2f8-c298a998be19 tempest-DeleteServersTestJSON-1941373802 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 19 19:46:14 devstack cinder-volume[87353]:   .first()
Jul 19 19:46:14 devstack cinder-volume[87353]: 
Jul 19 19:46:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-82bfd410-a665-4950-8137-c838780e016e req-8c3e772e-0704-4001-b2f8-c298a998be19 tempest-DeleteServersTestJSON-1941373802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-82bfd410-a665-4950-8137-c838780e016e req-8c3e772e-0704-4001-b2f8-c298a998be19 tempest-DeleteServersTestJSON-1941373802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-82bfd410-a665-4950-8137-c838780e016e req-8c3e772e-0704-4001-b2f8-c298a998be19 tempest-DeleteServersTestJSON-1941373802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-82bfd410-a665-4950-8137-c838780e016e req-8c3e772e-0704-4001-b2f8-c298a998be19 tempest-DeleteServersTestJSON-1941373802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9eb8d9ce-484f-490d-8391-92e52cb1623b', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:46:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-82bfd410-a665-4950-8137-c838780e016e req-8c3e772e-0704-4001-b2f8-c298a998be19 tempest-DeleteServersTestJSON-1941373802 None] attachment_update completed successfully.
Jul 19 19:46:20 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-7c83bc58-e669-445d-80d0-fd91a85837fc req-45b63589-694d-4bb2-aaf1-43f1a7fcd9b8 tempest-DeleteServersTestJSON-1941373802 None] Terminate volume connection completed successfully.
Jul 19 19:46:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-7c83bc58-e669-445d-80d0-fd91a85837fc req-45b63589-694d-4bb2-aaf1-43f1a7fcd9b8 tempest-DeleteServersTestJSON-1941373802 None] Deleting attachment 9eb8d9ce-484f-490d-8391-92e52cb1623b. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:46:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Acquiring lock "cinder-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:46:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Lock "cinder-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:46:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Acquiring lock "cinder-quobyte-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:46:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Lock "cinder-quobyte-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:46:21 devstack cinder-volume[87353]: INFO oslo.privsep.daemon [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0yozmvcs/privsep.sock']
Jul 19 19:46:21 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0yozmvcs/privsep.sock
Jul 19 19:46:21 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 19 19:46:22 devstack cinder-volume[87353]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Jul 19 19:46:23 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:23 devstack cinder-volume[87353]: INFO oslo.privsep.daemon [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Spawned new privsep daemon via rootwrap
Jul 19 19:46:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Accepted privsep connection to /tmp/tmp0yozmvcs/privsep.sock {{(pid=87353) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 19 19:46:23 devstack cinder-volume[87353]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 19 19:46:23 devstack cinder-volume[87353]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 19 19:46:23 devstack cinder-volume[87353]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 19 19:46:23 devstack cinder-volume[87353]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88926
Jul 19 19:46:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a47842-eb4e-49d0-8023-8399b1c6120f]: (2,) {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:46:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd201dd-4745-4067-b707-5950c057c6ba]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:46:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:23 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e
Jul 19 19:46:23 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:23 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e" returned: 0 in 0.718s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:23 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e
Jul 19 19:46:23 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:24 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e" returned: 0 in 0.359s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Lock "cinder-quobyte-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e" released by "delete_volume" :: held 2.431s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:46:24 devstack cinder-volume[87353]: WARNING cinder.quota [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:46:24 devstack cinder-volume[87353]: WARNING cinder.quota [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Created reservations ['b83d2558-e463-43dd-ae64-154f209ed0de', 'fe0134dc-54ef-4c0a-9d7c-5629ddcb1701', '93ec6ceb-d036-4283-bcb9-7ce8c15da549', '381011fa-7700-4590-a49d-39b094f75df0'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:24 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:46:24 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:24 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.295s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:46:24 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Deleted volume successfully.
Jul 19 19:46:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4baf9a5f-ed67-41c4-ae4d-b05501e25735 tempest-DeleteServersTestJSON-1941373802 None] Lock "cinder-3a82f7f8-cea2-44ce-8fcc-bf7bd0e3650e-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Flow 'volume_create_manager' (4019d90f-feaf-4600-b2bd-1548e09a275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd37aa14-c922-4b7b-a6ce-378b8ea1ad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd37aa14-c922-4b7b-a6ce-378b8ea1ad98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1665407192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b028e8-320d-4611-982f-bc77fa882c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ec854ca4504d6ca21553dfa7951036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:46:31Z,use_quota=True,user_id='8f6b320e58f5493291ab554a10d51a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ecbb772-e5d1-422a-8443-df5b82bfb0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ecbb772-e5d1-422a-8443-df5b82bfb0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c27ed3a-b4a8-485f-b0da-5dac25c3933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c27ed3a-b4a8-485f-b0da-5dac25c3933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b028e8-320d-4611-982f-bc77fa882c2d', 'volume_name': 'volume-42b028e8-320d-4611-982f-bc77fa882c2d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5189837a-9cb1-460d-b8ab-8b9e6bd7565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5189837a-9cb1-460d-b8ab-8b9e6bd7565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad17f31-eb2f-49e4-b42b-eda25e935c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:31 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Volume 42b028e8-320d-4611-982f-bc77fa882c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b028e8-320d-4611-982f-bc77fa882c2d', 'volume_size': 1}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1665407192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b028e8-320d-4611-982f-bc77fa882c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ec854ca4504d6ca21553dfa7951036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:46:31Z,use_quota=True,user_id='8f6b320e58f5493291ab554a10d51a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Creating volume 42b028e8-320d-4611-982f-bc77fa882c2d {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:46:31 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:46:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:31 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d 1073741824
Jul 19 19:46:31 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:32 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d 1073741824" returned: 0 in 0.669s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:32 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d
Jul 19 19:46:32 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:32 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d" returned: 0 in 0.343s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad17f31-eb2f-49e4-b42b-eda25e935c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b028e8-320d-4611-982f-bc77fa882c2d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd91202-0903-4780-b543-61c2f62acb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:46:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Volume volume-42b028e8-320d-4611-982f-bc77fa882c2d (42b028e8-320d-4611-982f-bc77fa882c2d): created successfully
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd91202-0903-4780-b543-61c2f62acb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Flow 'volume_create_manager' (4019d90f-feaf-4600-b2bd-1548e09a275e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:46:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ea3e3dd6-4b35-477f-803a-146017c22030 tempest-AttachVolumeNegativeTest-664486592 None] Created volume successfully.
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:46:32 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:46:32 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:46:33 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Jul 19 19:46:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.280s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:46:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:46:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:46:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 8 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:46:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:46:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e4c1a942-b56f-41e1-a57f-22f7c3ffb082 req-718fcb39-4653-4fba-9bf5-b433e06f82be tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:46:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e4c1a942-b56f-41e1-a57f-22f7c3ffb082 req-718fcb39-4653-4fba-9bf5-b433e06f82be tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:46:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e4c1a942-b56f-41e1-a57f-22f7c3ffb082 req-718fcb39-4653-4fba-9bf5-b433e06f82be tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:46:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-e4c1a942-b56f-41e1-a57f-22f7c3ffb082 req-718fcb39-4653-4fba-9bf5-b433e06f82be tempest-AttachVolumeNegativeTest-664486592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-42b028e8-320d-4611-982f-bc77fa882c2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b94b4f01-3edd-4e32-8488-69147dd1f67b', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:46:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-e4c1a942-b56f-41e1-a57f-22f7c3ffb082 req-718fcb39-4653-4fba-9bf5-b433e06f82be tempest-AttachVolumeNegativeTest-664486592 None] attachment_update completed successfully.
Jul 19 19:46:44 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=28,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:46:44 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=22,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:47:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-553b97aa-48fe-42ef-86ec-07d0854ddf34 req-fa8b47ca-e5aa-4347-ad48-784af9411a8c tempest-TaggedAttachmentsTest-385267696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-553b97aa-48fe-42ef-86ec-07d0854ddf34 req-fa8b47ca-e5aa-4347-ad48-784af9411a8c tempest-TaggedAttachmentsTest-385267696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-553b97aa-48fe-42ef-86ec-07d0854ddf34 req-fa8b47ca-e5aa-4347-ad48-784af9411a8c tempest-TaggedAttachmentsTest-385267696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-553b97aa-48fe-42ef-86ec-07d0854ddf34 req-fa8b47ca-e5aa-4347-ad48-784af9411a8c tempest-TaggedAttachmentsTest-385267696 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-6411cb47-5797-41d9-b010-a20babcfa69e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '120c6752-b067-4f26-98c7-b74493fa4262', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:47:09 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-553b97aa-48fe-42ef-86ec-07d0854ddf34 req-fa8b47ca-e5aa-4347-ad48-784af9411a8c tempest-TaggedAttachmentsTest-385267696 None] attachment_update completed successfully.
Jul 19 19:47:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-901df4ad-35ea-431a-83bf-b7b4ddb5480d req-384570ad-10bc-48bc-811e-f5e93bcbfc38 tempest-TaggedAttachmentsTest-385267696 None] Terminate volume connection completed successfully.
Jul 19 19:47:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-901df4ad-35ea-431a-83bf-b7b4ddb5480d req-384570ad-10bc-48bc-811e-f5e93bcbfc38 tempest-TaggedAttachmentsTest-385267696 None] Deleting attachment 120c6752-b067-4f26-98c7-b74493fa4262. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:47:19 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:47:25 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:47:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:47:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:47:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:47:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:32 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:47:32 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:33 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.646s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:47:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Acquiring lock "cinder-6411cb47-5797-41d9-b010-a20babcfa69e-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:47:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Lock "cinder-6411cb47-5797-41d9-b010-a20babcfa69e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:47:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Acquiring lock "cinder-quobyte-6411cb47-5797-41d9-b010-a20babcfa69e" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:47:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Lock "cinder-quobyte-6411cb47-5797-41d9-b010-a20babcfa69e" acquired by "delete_volume" :: waited 0.046s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:47:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdf132e-fbeb-4e8e-8c31-bbbe2ac9cdad]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:47:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:35 devstack sudo[90074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e
Jul 19 19:47:35 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:35 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e" returned: 0 in 0.815s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:35 devstack sudo[90084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e
Jul 19 19:47:35 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-60f6db3a-2b18-4b8e-a229-1a3035193d21 req-e59835a2-ddda-43b9-b486-5df908f0d4ef tempest-AttachVolumeNegativeTest-664486592 None] Terminate volume connection completed successfully.
Jul 19 19:47:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-60f6db3a-2b18-4b8e-a229-1a3035193d21 req-e59835a2-ddda-43b9-b486-5df908f0d4ef tempest-AttachVolumeNegativeTest-664486592 None] Deleting attachment b94b4f01-3edd-4e32-8488-69147dd1f67b. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:47:36 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6411cb47-5797-41d9-b010-a20babcfa69e" returned: 0 in 0.573s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Lock "cinder-quobyte-6411cb47-5797-41d9-b010-a20babcfa69e" released by "delete_volume" :: held 1.518s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Created reservations ['c5c3f961-7daf-4b41-aab3-543a159b52bf', 'bd99a8d8-82fb-459e-ac8b-47ec668bd352', 'dc4a4e58-fe67-4c93-be91-c5547624707d', 'caca1d6c-6160-42dc-8876-268f3e45a9ae'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Flow 'volume_create_manager' (d4e5a113-1498-4869-a40c-7b183c43d95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f146a631-d0dc-4b30-b125-d9034a51fc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f146a631-d0dc-4b30-b125-d9034a51fc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-111403401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9db8cd6-1046-4d90-8718-3e8a9639cf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0263f6c8fa684691b3b3afd06730f7ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:47:36Z,use_quota=True,user_id='84b9890526e74068b7d5112bb1c97be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efa16be-8f3e-4f70-8e78-b926e28be0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efa16be-8f3e-4f70-8e78-b926e28be0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1e9e43-e31b-4b23-90e3-b8ae9c1d0dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1e9e43-e31b-4b23-90e3-b8ae9c1d0dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9db8cd6-1046-4d90-8718-3e8a9639cf69', 'volume_name': 'volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2b2df4-fde6-4058-a171-ca66d1abb883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2b2df4-fde6-4058-a171-ca66d1abb883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f72dd53-c24d-48fb-8be7-2a54c07e2f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:36 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Volume c9db8cd6-1046-4d90-8718-3e8a9639cf69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69', 'volume_size': 1}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-111403401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9db8cd6-1046-4d90-8718-3e8a9639cf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0263f6c8fa684691b3b3afd06730f7ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:47:36Z,use_quota=True,user_id='84b9890526e74068b7d5112bb1c97be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Creating volume c9db8cd6-1046-4d90-8718-3e8a9639cf69 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:47:36 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:36 devstack sudo[90095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69 1073741824
Jul 19 19:47:36 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:36 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:47:36 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:37 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.703s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:47:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Deleted volume successfully.
Jul 19 19:47:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41fb8e62-0d98-4672-9258-f31923d94b84 tempest-TaggedAttachmentsTest-385267696 None] Lock "cinder-6411cb47-5797-41d9-b010-a20babcfa69e-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:47:37 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69 1073741824" returned: 0 in 0.941s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:37 devstack sudo[90113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69
Jul 19 19:47:37 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:38 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69" returned: 0 in 0.448s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:47:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f72dd53-c24d-48fb-8be7-2a54c07e2f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b0f507-6104-4bff-b2db-bb0f0cf67f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:38 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Volume volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69 (c9db8cd6-1046-4d90-8718-3e8a9639cf69): created successfully
Jul 19 19:47:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b0f507-6104-4bff-b2db-bb0f0cf67f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Flow 'volume_create_manager' (d4e5a113-1498-4869-a40c-7b183c43d95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:47:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-715adf53-11b5-4e9a-b2a7-934177ff0dae tempest-ServerRescueNegativeTestJSON-603598663 None] Created volume successfully.
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Flow 'volume_create_manager' (f07ceabb-7df2-4959-bbd4-9136d416db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1c4c49-4597-4040-9f77-64bf2139da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1c4c49-4597-4040-9f77-64bf2139da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1582986821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368c3d7b-288b-4908-aee0-af1ff44ffcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2248e09b324f45b388aba5f3d070dac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:47:47Z,use_quota=True,user_id='d4a8220ba0c242bba5ef23fe9560858b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7acb2d-b36f-4912-b6ce-f83254fa10fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7acb2d-b36f-4912-b6ce-f83254fa10fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0b1f68-9382-4887-bfdb-6c2a6ea9b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0b1f68-9382-4887-bfdb-6c2a6ea9b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368c3d7b-288b-4908-aee0-af1ff44ffcfd', 'volume_name': 'volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9083f162-dc96-42cc-bf5a-dfec6e9f9ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9083f162-dc96-42cc-bf5a-dfec6e9f9ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0cd921-e832-4a82-8218-acf7f6d2a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:47 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Volume 368c3d7b-288b-4908-aee0-af1ff44ffcfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd', 'volume_size': 1}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1582986821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368c3d7b-288b-4908-aee0-af1ff44ffcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2248e09b324f45b388aba5f3d070dac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:47:47Z,use_quota=True,user_id='d4a8220ba0c242bba5ef23fe9560858b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Creating volume 368c3d7b-288b-4908-aee0-af1ff44ffcfd {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:47:47 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:47:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:47 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd 1073741824
Jul 19 19:47:47 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:48 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd 1073741824" returned: 0 in 1.055s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:48 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd
Jul 19 19:47:48 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:49 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd" returned: 0 in 0.536s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:47:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0cd921-e832-4a82-8218-acf7f6d2a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2401306-4da9-416b-b437-4d070b6fe89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:47:49 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Volume volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd (368c3d7b-288b-4908-aee0-af1ff44ffcfd): created successfully
Jul 19 19:47:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2401306-4da9-416b-b437-4d070b6fe89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:47:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Flow 'volume_create_manager' (f07ceabb-7df2-4959-bbd4-9136d416db55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:47:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-757de384-f67b-48ec-aa8b-508722e94e08 tempest-VolumesAdminNegativeTest-1935507274 None] Created volume successfully.
Jul 19 19:47:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Acquiring lock "cinder-368c3d7b-288b-4908-aee0-af1ff44ffcfd-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:47:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "cinder-368c3d7b-288b-4908-aee0-af1ff44ffcfd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:47:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Acquiring lock "cinder-quobyte-368c3d7b-288b-4908-aee0-af1ff44ffcfd" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:47:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "cinder-quobyte-368c3d7b-288b-4908-aee0-af1ff44ffcfd" acquired by "delete_volume" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:47:50 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0835896-7874-4bd6-bfbc-d1c8e70a0d71]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:47:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:50 devstack sudo[90292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd
Jul 19 19:47:50 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:50 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd" returned: 0 in 0.504s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:51 devstack sudo[90297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd
Jul 19 19:47:51 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:51 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-368c3d7b-288b-4908-aee0-af1ff44ffcfd" returned: 0 in 0.662s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "cinder-quobyte-368c3d7b-288b-4908-aee0-af1ff44ffcfd" released by "delete_volume" :: held 1.250s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Created reservations ['adae9f07-8c53-4027-8530-ae3b52890f3b', 'b65ad92b-bd13-4533-9e2c-576a1acca9db', '00e154dd-835d-499d-9451-2fd60fd2de98', 'c910f586-c611-4b41-a37c-9e4bd929e26a'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:47:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:47:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:52 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:47:52 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:52 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.314s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:52 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:47:52 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Deleted volume successfully.
Jul 19 19:47:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2be15b2-57b5-4f87-8955-68326834a9f3 tempest-VolumesAdminNegativeTest-1935507274 None] Lock "cinder-368c3d7b-288b-4908-aee0-af1ff44ffcfd-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:47:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Acquiring lock "cinder-c9db8cd6-1046-4d90-8718-3e8a9639cf69-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:47:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "cinder-c9db8cd6-1046-4d90-8718-3e8a9639cf69-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:47:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Acquiring lock "cinder-quobyte-c9db8cd6-1046-4d90-8718-3e8a9639cf69" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:47:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "cinder-quobyte-c9db8cd6-1046-4d90-8718-3e8a9639cf69" acquired by "delete_volume" :: waited 0.065s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:47:56 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eba225-afd8-452d-ac24-4156735c5a08]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:47:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:56 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69
Jul 19 19:47:56 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:57 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69" returned: 0 in 0.672s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:57 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69
Jul 19 19:47:57 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:57 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c9db8cd6-1046-4d90-8718-3e8a9639cf69" returned: 0 in 0.727s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "cinder-quobyte-c9db8cd6-1046-4d90-8718-3e8a9639cf69" released by "delete_volume" :: held 1.536s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Created reservations ['c33e8292-e2f7-4e24-b666-93ae47d071e4', '9490c9a0-90ff-4a0b-a307-cfb2a99a1b08', 'e2e802ed-98d2-4d65-8e4f-72910e5c59cc', 'acf067d1-0fa0-4dc7-8549-f6310fa6f47a'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:47:58 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:47:58 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:47:58 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.395s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:47:58 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Deleted volume successfully.
Jul 19 19:47:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a11f121-854a-481c-bb01-4c717f067c6b tempest-ServerRescueNegativeTestJSON-603598663 None] Lock "cinder-c9db8cd6-1046-4d90-8718-3e8a9639cf69-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:48:08 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=32,cinder:SELECT=17,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:48:08 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Flow 'volume_create_manager' (a56dec16-dfde-4218-b8ca-7abd27162bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19aa753c-054c-42af-84d8-48fe61229ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:32 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:48:32 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19aa753c-054c-42af-84d8-48fe61229ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1537857321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62f7749-e5ba-4c86-a1a1-6a79216ef6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00441f6bb7f4eaf99a02b6e9dc24f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:33Z,use_quota=True,user_id='37ae0fdce01a479694419a3d0a877c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342c411a-835f-4661-8ba3-d1102dc3a510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342c411a-835f-4661-8ba3-d1102dc3a510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62c918b-d9a1-4bdf-b87b-5e4b1beeac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62c918b-d9a1-4bdf-b87b-5e4b1beeac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62f7749-e5ba-4c86-a1a1-6a79216ef6d2', 'volume_name': 'volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab1d623-d27a-43c9-a2c4-4f08ded9055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab1d623-d27a-43c9-a2c4-4f08ded9055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e450302-894a-4ab0-b917-b589af427b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Volume c62f7749-e5ba-4c86-a1a1-6a79216ef6d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2', 'volume_size': 1}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1537857321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62f7749-e5ba-4c86-a1a1-6a79216ef6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00441f6bb7f4eaf99a02b6e9dc24f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:33Z,use_quota=True,user_id='37ae0fdce01a479694419a3d0a877c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Creating volume c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:48:32 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:48:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:33 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 1073741824
Jul 19 19:48:33 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:33 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.700s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:48:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:48:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 8 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:48:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:48:33 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 1073741824" returned: 0 in 1.002s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:34 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2
Jul 19 19:48:34 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Flow 'volume_create_manager' (d1b7fa72-bc22-4bc2-85a4-adbcd8dca069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033d9486-d1e5-4a7a-bb87-d6a5c832bcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033d9486-d1e5-4a7a-bb87-d6a5c832bcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1567189349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc71005-a455-4da6-bf5f-0b2c5ab83a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ec854ca4504d6ca21553dfa7951036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:34Z,use_quota=True,user_id='8f6b320e58f5493291ab554a10d51a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e62ae10-1922-497b-be87-04345753590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e62ae10-1922-497b-be87-04345753590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80becd1-c393-4a11-8210-dd0391f68aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80becd1-c393-4a11-8210-dd0391f68aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc71005-a455-4da6-bf5f-0b2c5ab83a68', 'volume_name': 'volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445a5e47-72df-488a-892e-4b50e31ed0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445a5e47-72df-488a-892e-4b50e31ed0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f33916-6da4-474f-aa58-6ae8fc71ca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Volume ecc71005-a455-4da6-bf5f-0b2c5ab83a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68', 'volume_size': 1}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:34 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" returned: 0 in 0.536s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.065s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1567189349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc71005-a455-4da6-bf5f-0b2c5ab83a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ec854ca4504d6ca21553dfa7951036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:34Z,use_quota=True,user_id='8f6b320e58f5493291ab554a10d51a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Creating volume ecc71005-a455-4da6-bf5f-0b2c5ab83a68 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:48:34 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e450302-894a-4ab0-b917-b589af427b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:34 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68 1073741824
Jul 19 19:48:34 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853d97e9-09ba-4e2f-a104-183a725e2543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Volume volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 (c62f7749-e5ba-4c86-a1a1-6a79216ef6d2): created successfully
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853d97e9-09ba-4e2f-a104-183a725e2543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Flow 'volume_create_manager' (a56dec16-dfde-4218-b8ca-7abd27162bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-28c9d85f-71ba-4d7a-a4ec-58820cc9a459 req-ba2e595c-b2b6-45bc-b9b3-f48c1ef37140 tempest-VolumesSnapshotsTestJSON-1706110187 None] Created volume successfully.
Jul 19 19:48:35 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68 1073741824" returned: 0 in 0.840s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:35 devstack sudo[90719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68
Jul 19 19:48:35 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:36 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68" returned: 0 in 0.474s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.491s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f33916-6da4-474f-aa58-6ae8fc71ca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50ccd59-df81-4ef3-a4fa-8a4f1304b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Creating offline snapshot 7514d487-7a22-4b80-9813-6a25eb4c9e5a of volume c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:48:36 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Volume volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68 (ecc71005-a455-4da6-bf5f-0b2c5ab83a68): created successfully
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50ccd59-df81-4ef3-a4fa-8a4f1304b14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Flow 'volume_create_manager' (d1b7fa72-bc22-4bc2-85a4-adbcd8dca069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd0a98f-ef09-4e3a-b948-942403580722]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0b06f569-cdc0-4e0b-9348-f967b5ce516c tempest-AttachVolumeNegativeTest-664486592 None] Created volume successfully.
Jul 19 19:48:36 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2
Jul 19 19:48:36 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:36 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" returned: 0 in 0.753s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:36 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a 1G
Jul 19 19:48:36 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:37 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a 1G" returned: 0 in 0.758s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:37 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a
Jul 19 19:48:37 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-4bcb7985-2393-4b57-800e-6d4c33563a24 req-b4ec1c3a-9dcf-4a1b-92a5-f3059c18c591 tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:38 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a" returned: 0 in 0.480s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:38 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a is being set with open permissions: ugo+rw
Jul 19 19:48:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:38 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a
Jul 19 19:48:38 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:38 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a" returned: 0 in 0.372s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:38 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.info
Jul 19 19:48:38 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:38 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.info" returned: 0 in 0.312s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:38 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.info is being set with open permissions: ugo+rw
Jul 19 19:48:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:38 devstack sudo[90760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.info
Jul 19 19:48:38 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:39 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.info" returned: 0 in 0.308s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.178s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-4bcb7985-2393-4b57-800e-6d4c33563a24 req-b4ec1c3a-9dcf-4a1b-92a5-f3059c18c591 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.363s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-4bcb7985-2393-4b57-800e-6d4c33563a24 req-b4ec1c3a-9dcf-4a1b-92a5-f3059c18c591 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-f3364ca0-bf2a-4309-98d9-6d7d095acd45 req-5aeb1e0b-e58c-4310-937f-8ec444b023be tempest-VolumesSnapshotsTestJSON-1706110187 None] Create snapshot completed successfully
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-4bcb7985-2393-4b57-800e-6d4c33563a24 req-b4ec1c3a-9dcf-4a1b-92a5-f3059c18c591 tempest-AttachVolumeNegativeTest-664486592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac919e4e-3813-404a-a1fa-4c4cd4607842', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:48:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-4bcb7985-2393-4b57-800e-6d4c33563a24 req-b4ec1c3a-9dcf-4a1b-92a5-f3059c18c591 tempest-AttachVolumeNegativeTest-664486592 None] attachment_update completed successfully.
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "cinder-7514d487-7a22-4b80-9813-6a25eb4c9e5a-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-7514d487-7a22-4b80-9813-6a25eb4c9e5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "cinder-quobyte-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-quobyte-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "cinder-quobyte-7514d487-7a22-4b80-9813-6a25eb4c9e5a" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-quobyte-7514d487-7a22-4b80-9813-6a25eb4c9e5a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Deleting offline snapshot 7514d487-7a22-4b80-9813-6a25eb4c9e5a of volume c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] snapshot_file for this snap is: volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0aa760-4b0c-4d0a-a244-3284c4d4f26d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:48:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:40 devstack sudo[91145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a
Jul 19 19:48:40 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:40 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a" returned: 0 in 0.504s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:48:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de49c9a-4d9f-4222-a627-016999bc0b75]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:48:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:40 devstack sudo[91152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2
Jul 19 19:48:40 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:40 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" returned: 0 in 0.477s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:41 devstack sudo[91158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a
Jul 19 19:48:41 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:41 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a" returned: 0 in 0.452s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:41 devstack sudo[91170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a
Jul 19 19:48:41 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:41 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2.7514d487-7a22-4b80-9813-6a25eb4c9e5a" returned: 0 in 0.368s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-quobyte-7514d487-7a22-4b80-9813-6a25eb4c9e5a" released by "_delete_snapshot" :: held 1.951s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:48:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-quobyte-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" released by "delete_snapshot" :: held 1.996s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:48:41 devstack cinder-volume[87353]: WARNING cinder.quota [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:48:41 devstack cinder-volume[87353]: DEBUG cinder.quota [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Created reservations ['8a83aefd-7883-414d-800c-c0a8fff19288', '828ccedf-5c97-432b-be58-72dcb8d9d996', '19b9d8d8-108a-4a30-804c-24ee8500a65e', 'bbacfd18-c3a8-4022-9c57-1b41e1b262d8'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:48:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Delete snapshot completed successfully.
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-a8f05392-d540-43f2-a779-af0cce59d8e0 req-0fbf55a4-f28a-4732-8d96-f44d5fc1ba58 tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-7514d487-7a22-4b80-9813-6a25eb4c9e5a-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:48:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-d5233946-65e0-4e78-98bf-cfb89ccfec02 req-09000117-58fd-4a61-951a-39688933cf6c tempest-AttachVolumeNegativeTest-664486592 None] Terminate volume connection completed successfully.
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-d5233946-65e0-4e78-98bf-cfb89ccfec02 req-09000117-58fd-4a61-951a-39688933cf6c tempest-AttachVolumeNegativeTest-664486592 None] Deleting attachment ac919e4e-3813-404a-a1fa-4c4cd4607842. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "cinder-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "cinder-quobyte-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-quobyte-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" acquired by "delete_volume" :: waited 0.044s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[37840e80-ebb1-41eb-a525-5a6e2f66f603]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:42 devstack sudo[91201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2
Jul 19 19:48:42 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:42 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" returned: 0 in 0.458s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:42 devstack sudo[91206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2
Jul 19 19:48:42 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:43 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" returned: 0 in 0.408s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-quobyte-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2" released by "delete_volume" :: held 0.973s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG cinder.quota [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Created reservations ['f7a9ddf8-6981-4f22-b4fb-91f24ce2e27b', '4aef52ed-6984-4777-afda-58ac15ead2b1', 'ae846398-5944-4e7c-9405-f72c39808d95', '3f16cefa-76ab-41b4-afdb-ccbbeabcee85'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:43 devstack sudo[91222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:48:43 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:44 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.827s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:44 devstack cinder-volume[87353]: DEBUG cinder.manager [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:48:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Deleted volume successfully.
Jul 19 19:48:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-e98d774a-3ea4-4a95-9f39-73ed479185d3 req-0718eeda-175f-44e0-924a-d6a19921c29d tempest-VolumesSnapshotsTestJSON-1706110187 None] Lock "cinder-c62f7749-e5ba-4c86-a1a1-6a79216ef6d2-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Flow 'volume_create_manager' (ca16916a-507c-4050-a662-c6dd126f0c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b92f6f6-aad5-4763-a818-d6215856f098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b92f6f6-aad5-4763-a818-d6215856f098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1469639121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b68f1866-6c95-4b7e-ab49-a8b1f5243157,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d83e5bf6f9d74a1b865f5ee9d68e4092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:50Z,use_quota=True,user_id='03c21349be284d299fd912ae9d391fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00916bfe-01f9-4fe1-8d54-40b60cf3f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00916bfe-01f9-4fe1-8d54-40b60cf3f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4c9a80-a8d3-4cfe-b542-1cd4b41d85a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4c9a80-a8d3-4cfe-b542-1cd4b41d85a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b68f1866-6c95-4b7e-ab49-a8b1f5243157', 'volume_name': 'volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b9cf5c-c59f-4012-8877-e26bd45b598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b9cf5c-c59f-4012-8877-e26bd45b598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be32873d-374e-41d1-8e19-c07ab8fa7d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:49 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Volume b68f1866-6c95-4b7e-ab49-a8b1f5243157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157', 'volume_size': 1}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1469639121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b68f1866-6c95-4b7e-ab49-a8b1f5243157,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d83e5bf6f9d74a1b865f5ee9d68e4092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:50Z,use_quota=True,user_id='03c21349be284d299fd912ae9d391fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Creating volume b68f1866-6c95-4b7e-ab49-a8b1f5243157 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:48:49 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:48:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:50 devstack sudo[91348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157 1073741824
Jul 19 19:48:50 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:50 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157 1073741824" returned: 0 in 0.527s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:50 devstack sudo[91353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157
Jul 19 19:48:50 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:51 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157" returned: 0 in 0.479s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:48:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be32873d-374e-41d1-8e19-c07ab8fa7d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5bdfc0-af3e-4d2b-a66d-d6fa97544db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:51 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Volume volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157 (b68f1866-6c95-4b7e-ab49-a8b1f5243157): created successfully
Jul 19 19:48:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5bdfc0-af3e-4d2b-a66d-d6fa97544db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Flow 'volume_create_manager' (ca16916a-507c-4050-a662-c6dd126f0c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0e2f43dc-c3e2-4a81-bf3f-0e210e43ca82 tempest-VolumesTestJSON-1911123400 None] Created volume successfully.
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Flow 'volume_create_manager' (8a67c2c7-6a00-4486-9427-b4cd0681f57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36640dab-5e87-41da-ba51-8ea07e2aacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36640dab-5e87-41da-ba51-8ea07e2aacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1285146234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb597beb-ceaf-4567-b86c-60c639b01170,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d83e5bf6f9d74a1b865f5ee9d68e4092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:53Z,use_quota=True,user_id='03c21349be284d299fd912ae9d391fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e287ff-2e78-4ad1-a41a-eafcfb652b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e287ff-2e78-4ad1-a41a-eafcfb652b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c2086b-73d3-4f0b-8d5a-6c0c4448d326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c2086b-73d3-4f0b-8d5a-6c0c4448d326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb597beb-ceaf-4567-b86c-60c639b01170', 'volume_name': 'volume-cb597beb-ceaf-4567-b86c-60c639b01170', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d77595-9f73-4144-b864-e583206b8018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d77595-9f73-4144-b864-e583206b8018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba3ddb1-9749-4778-bb51-0c7cab319d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:53 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Volume cb597beb-ceaf-4567-b86c-60c639b01170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb597beb-ceaf-4567-b86c-60c639b01170', 'volume_size': 1}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1285146234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb597beb-ceaf-4567-b86c-60c639b01170,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d83e5bf6f9d74a1b865f5ee9d68e4092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:53Z,use_quota=True,user_id='03c21349be284d299fd912ae9d391fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Creating volume cb597beb-ceaf-4567-b86c-60c639b01170 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:48:53 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:48:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:53 devstack sudo[91365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170 1073741824
Jul 19 19:48:53 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:54 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170 1073741824" returned: 0 in 0.888s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:54 devstack sudo[91371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170
Jul 19 19:48:54 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:54 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170" returned: 0 in 0.333s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba3ddb1-9749-4778-bb51-0c7cab319d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb597beb-ceaf-4567-b86c-60c639b01170', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2ab4ca-5b47-4023-a331-1de6770bccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:54 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Volume volume-cb597beb-ceaf-4567-b86c-60c639b01170 (cb597beb-ceaf-4567-b86c-60c639b01170): created successfully
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2ab4ca-5b47-4023-a331-1de6770bccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Flow 'volume_create_manager' (8a67c2c7-6a00-4486-9427-b4cd0681f57c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:54 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a0399674-fd5f-42f2-87f6-0bcc27b46520 tempest-VolumesTestJSON-1911123400 None] Created volume successfully.
Jul 19 19:48:55 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:48:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Flow 'volume_create_manager' (9ddeaa89-dffd-453d-93fa-7f2ddbb87e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a72a25c-325d-40af-89c9-7978ebdab848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a72a25c-325d-40af-89c9-7978ebdab848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-894836380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d83e5bf6f9d74a1b865f5ee9d68e4092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:56Z,use_quota=True,user_id='03c21349be284d299fd912ae9d391fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2375d24-891c-4913-a77d-99143677e304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2375d24-891c-4913-a77d-99143677e304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7291ef82-cee3-42c8-a2a0-1996a60c48ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7291ef82-cee3-42c8-a2a0-1996a60c48ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9', 'volume_name': 'volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e290f27-f3a7-4800-949e-a959e0973090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e290f27-f3a7-4800-949e-a959e0973090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a845f-30b9-4d46-b89d-e297b52274dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:56 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Volume 6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9', 'volume_size': 1}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-894836380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d83e5bf6f9d74a1b865f5ee9d68e4092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:48:56Z,use_quota=True,user_id='03c21349be284d299fd912ae9d391fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Creating volume 6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:48:56 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:56 devstack sudo[91390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9 1073741824
Jul 19 19:48:56 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:56 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9 1073741824" returned: 0 in 0.470s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:48:56 devstack sudo[91398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9
Jul 19 19:48:56 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:48:56 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9" returned: 0 in 0.292s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a845f-30b9-4d46-b89d-e297b52274dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af84dc0-51e1-410c-968f-aae573010287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:48:56 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Volume volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9 (6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9): created successfully
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af84dc0-51e1-410c-968f-aae573010287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:48:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Flow 'volume_create_manager' (9ddeaa89-dffd-453d-93fa-7f2ddbb87e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:48:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-908e35ea-a844-4fc0-8be2-1234a863567c tempest-VolumesTestJSON-1911123400 None] Created volume successfully.
Jul 19 19:48:59 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Flow 'volume_create_manager' (6c8bb341-b20a-4778-98e3-ffed19c21ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685b458e-296c-4598-99d5-e8075a206c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685b458e-296c-4598-99d5-e8075a206c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-256601912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43dad1f6-fea1-428d-b620-617d6a4a457a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30d4f688b3f41a9bedda3fe092d4ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:00Z,use_quota=True,user_id='ae0f8d012c37468a8c49a612ed378dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7e39d9-f037-4dec-8a77-ccb6ebe357e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7e39d9-f037-4dec-8a77-ccb6ebe357e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d72c3c3-48f2-48ad-928e-d7550a2d4baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d72c3c3-48f2-48ad-928e-d7550a2d4baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43dad1f6-fea1-428d-b620-617d6a4a457a', 'volume_name': 'volume-43dad1f6-fea1-428d-b620-617d6a4a457a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2344e1c0-1478-4ea7-b639-9163f80cbc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2344e1c0-1478-4ea7-b639-9163f80cbc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd93b0a-f3e7-4a80-bc4b-4eaa94486aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:00 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Volume 43dad1f6-fea1-428d-b620-617d6a4a457a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43dad1f6-fea1-428d-b620-617d6a4a457a', 'volume_size': 1}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-256601912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43dad1f6-fea1-428d-b620-617d6a4a457a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d30d4f688b3f41a9bedda3fe092d4ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:00Z,use_quota=True,user_id='ae0f8d012c37468a8c49a612ed378dbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Creating volume 43dad1f6-fea1-428d-b620-617d6a4a457a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:49:00 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:00 devstack sudo[91474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a 1073741824
Jul 19 19:49:00 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Acquiring lock "cinder-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Lock "cinder-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Acquiring lock "cinder-quobyte-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Lock "cinder-quobyte-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9" acquired by "delete_volume" :: waited 0.063s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee3e4f5-935b-4e73-b89a-3cf07f4ce058]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:00 devstack sudo[91478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9
Jul 19 19:49:00 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:01 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a 1073741824" returned: 0 in 0.920s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:01 devstack sudo[91485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a
Jul 19 19:49:01 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:01 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9" returned: 0 in 0.751s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:01 devstack sudo[91487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9
Jul 19 19:49:01 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:01 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9" returned: 0 in 0.488s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Lock "cinder-quobyte-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9" released by "delete_volume" :: held 1.354s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:01 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Created reservations ['27c13fc5-6b1f-4c26-a39e-2cb479b1ea53', '99630e11-e507-4bbd-99ad-eed500c40d86', '4f6f1dae-8652-400e-9b1e-8a26ef4b7ecd', '9a23e20d-8473-476d-a97f-6b81a561f588'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:01 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a" returned: 0 in 0.883s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd93b0a-f3e7-4a80-bc4b-4eaa94486aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43dad1f6-fea1-428d-b620-617d6a4a457a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d655cf86-9740-4880-98cf-55c2fcac5a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Volume volume-43dad1f6-fea1-428d-b620-617d6a4a457a (43dad1f6-fea1-428d-b620-617d6a4a457a): created successfully
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d655cf86-9740-4880-98cf-55c2fcac5a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Flow 'volume_create_manager' (6c8bb341-b20a-4778-98e3-ffed19c21ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-62baa943-54f0-46f4-9c72-d5ab0d7d4271 tempest-ServerActionsTestOtherA-62752874 None] Created volume successfully.
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:02 devstack sudo[91491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:02 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Acquiring lock "cinder-cb597beb-ceaf-4567-b86c-60c639b01170-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Lock "cinder-cb597beb-ceaf-4567-b86c-60c639b01170-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:02 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.658s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:02 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Deleted volume successfully.
Jul 19 19:49:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9a564808-dd5b-46b2-8dfb-3a8e83b5119a tempest-VolumesTestJSON-1911123400 None] Lock "cinder-6b0a5652-c588-4abf-b5bf-d0fd2c5d37f9-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Acquiring lock "cinder-quobyte-cb597beb-ceaf-4567-b86c-60c639b01170" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Lock "cinder-quobyte-cb597beb-ceaf-4567-b86c-60c639b01170" acquired by "delete_volume" :: waited 0.056s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:03 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e435a00f-b618-434f-9e18-52f7099a45dd]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:03 devstack sudo[91526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170
Jul 19 19:49:03 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:04 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170" returned: 0 in 0.831s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:04 devstack sudo[91539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170
Jul 19 19:49:04 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:04 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cb597beb-ceaf-4567-b86c-60c639b01170" returned: 0 in 0.426s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Lock "cinder-quobyte-cb597beb-ceaf-4567-b86c-60c639b01170" released by "delete_volume" :: held 1.347s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Created reservations ['9200e2aa-2566-4668-859f-a55874bc0450', '48ad7e46-107a-47f6-a84b-ff0f3cfffede', 'ed53b971-dcba-4700-8713-835fb3c93b8b', '87ff4de4-cf04-476f-beac-5bcb412b615d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:04 devstack sudo[91551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:04 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:05 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.373s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:05 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Deleted volume successfully.
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-24c81fe6-c4ee-4930-896d-5d1ed818e00a tempest-VolumesTestJSON-1911123400 None] Lock "cinder-cb597beb-ceaf-4567-b86c-60c639b01170-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Acquiring lock "cinder-b68f1866-6c95-4b7e-ab49-a8b1f5243157-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Lock "cinder-b68f1866-6c95-4b7e-ab49-a8b1f5243157-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Acquiring lock "cinder-quobyte-b68f1866-6c95-4b7e-ab49-a8b1f5243157" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Lock "cinder-quobyte-b68f1866-6c95-4b7e-ab49-a8b1f5243157" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a2a798-5426-4561-8898-3c6f4f55cb4b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:05 devstack sudo[91557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157
Jul 19 19:49:05 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:05 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157" returned: 0 in 0.410s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:05 devstack sudo[91563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157
Jul 19 19:49:05 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:06 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b68f1866-6c95-4b7e-ab49-a8b1f5243157" returned: 0 in 0.271s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Lock "cinder-quobyte-b68f1866-6c95-4b7e-ab49-a8b1f5243157" released by "delete_volume" :: held 0.740s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Created reservations ['1f192496-a521-45a6-a50f-880f8668fdea', '0fe6e89d-2ede-48e7-8a54-f57ffb34525a', 'a042c0f2-fd70-4a67-916f-96852afef677', '33775bf8-0eb4-4da8-8d36-ca5f2e2960c9'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:06 devstack sudo[91567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:06 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:06 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.299s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:06 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Deleted volume successfully.
Jul 19 19:49:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8ca49913-0423-4021-a7ef-d4b6cf2af16f tempest-VolumesTestJSON-1911123400 None] Lock "cinder-b68f1866-6c95-4b7e-ab49-a8b1f5243157-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0c9f65b9-6b33-4a73-ad3b-5bc14ca7d8fe tempest-BackendsCapabilitiesAdminTestsJSON-830253789 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87353) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 19 19:49:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dde1de51-b79c-4aa8-bb8a-473b36576cbc tempest-BackendsCapabilitiesAdminTestsJSON-830253789 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87353) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Flow 'volume_create_manager' (9a7fbf69-632a-4cbf-b527-e575f490d5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de40749a-20c7-4e77-9576-5e0c8290952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de40749a-20c7-4e77-9576-5e0c8290952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1753707252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b499c908-65be-48ea-be3e-58d48913b67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a4b45c6e7c40ce965d6b7f75df9c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:14Z,use_quota=True,user_id='ef95ba5e871749c4a2e0f7ddc82fa851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0b05e8-f546-417b-9d2e-28176e007682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0b05e8-f546-417b-9d2e-28176e007682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6d2193-c223-4a07-9646-da80653a9b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6d2193-c223-4a07-9646-da80653a9b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b499c908-65be-48ea-be3e-58d48913b67d', 'volume_name': 'volume-b499c908-65be-48ea-be3e-58d48913b67d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be39ce2-daef-4163-b23d-225b4aab1b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be39ce2-daef-4163-b23d-225b4aab1b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f9dc46-609c-493d-8904-0f00ade4134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:13 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Volume b499c908-65be-48ea-be3e-58d48913b67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b499c908-65be-48ea-be3e-58d48913b67d', 'volume_size': 1}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1753707252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b499c908-65be-48ea-be3e-58d48913b67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a4b45c6e7c40ce965d6b7f75df9c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:14Z,use_quota=True,user_id='ef95ba5e871749c4a2e0f7ddc82fa851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Creating volume b499c908-65be-48ea-be3e-58d48913b67d {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:49:13 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:49:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:13 devstack sudo[91668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d 1073741824
Jul 19 19:49:13 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:14 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d 1073741824" returned: 0 in 0.575s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:14 devstack sudo[91675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d
Jul 19 19:49:14 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:14 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d" returned: 0 in 0.394s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:49:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f9dc46-609c-493d-8904-0f00ade4134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b499c908-65be-48ea-be3e-58d48913b67d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758eaad9-4c00-4169-8ad9-2c99d92e0e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:15 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Volume volume-b499c908-65be-48ea-be3e-58d48913b67d (b499c908-65be-48ea-be3e-58d48913b67d): created successfully
Jul 19 19:49:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758eaad9-4c00-4169-8ad9-2c99d92e0e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Flow 'volume_create_manager' (9a7fbf69-632a-4cbf-b527-e575f490d5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4420aa2f-1210-40b6-af09-ce4636f58f52 tempest-AttachVolumeShelveTestJSON-179779931 None] Created volume successfully.
Jul 19 19:49:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-48406ca8-974d-4841-bdaa-2d6c1c1d71db tempest-GroupSnapshotsV319Test-1049762430 None] Group tempest-GroupSnapshotsV319Test-Group-2029959296: creating
Jul 19 19:49:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-48406ca8-974d-4841-bdaa-2d6c1c1d71db tempest-GroupSnapshotsV319Test-1049762430 None] Group tempest-GroupSnapshotsV319Test-Group-2029959296: created successfully
Jul 19 19:49:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-48406ca8-974d-4841-bdaa-2d6c1c1d71db tempest-GroupSnapshotsV319Test-1049762430 None] Create group completed successfully.
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Flow 'volume_create_manager' (e1a860fe-ca2d-43ce-99cf-949c97efeda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493a94a6-21be-4f47-8c6a-166bce11898e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493a94a6-21be-4f47-8c6a-166bce11898e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1380386411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=375231c5-7117-4be1-a5fd-e5f3e2892c39,host='devstack@QuobyteHD#QuobyteHD',id=75caeed8-1f24-4579-b87d-060bef476ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087a2e1a97a04d429788ae1a3d1c1119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:21Z,use_quota=True,user_id='79be519e9ccb4ad5b98a63ad89f06e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9517d6aa-15b1-4038-908e-2281e7bcfe2c),volume_type_id=9517d6aa-15b1-4038-908e-2281e7bcfe2c)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff54538-aab0-41ce-896d-b1fe9db8076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff54538-aab0-41ce-896d-b1fe9db8076b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b5fe02-5e67-473e-bab7-03d6ca1f9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b5fe02-5e67-473e-bab7-03d6ca1f9d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75caeed8-1f24-4579-b87d-060bef476ce9', 'volume_name': 'volume-75caeed8-1f24-4579-b87d-060bef476ce9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f606e1c8-04b0-4b62-ad6c-95c85efdb5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f606e1c8-04b0-4b62-ad6c-95c85efdb5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62604c15-31c2-4d1e-8a8b-733519722da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:21 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Volume 75caeed8-1f24-4579-b87d-060bef476ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75caeed8-1f24-4579-b87d-060bef476ce9', 'volume_size': 1}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=375231c5-7117-4be1-a5fd-e5f3e2892c39,created_at=2026-07-19T17:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1380386411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=375231c5-7117-4be1-a5fd-e5f3e2892c39,host='devstack@QuobyteHD#QuobyteHD',id=75caeed8-1f24-4579-b87d-060bef476ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087a2e1a97a04d429788ae1a3d1c1119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:21Z,use_quota=True,user_id='79be519e9ccb4ad5b98a63ad89f06e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9517d6aa-15b1-4038-908e-2281e7bcfe2c),volume_type_id=9517d6aa-15b1-4038-908e-2281e7bcfe2c)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Creating volume 75caeed8-1f24-4579-b87d-060bef476ce9 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:49:21 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:49:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:21 devstack sudo[91736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9 1073741824
Jul 19 19:49:21 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:22 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9 1073741824" returned: 0 in 0.702s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:22 devstack sudo[91743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9
Jul 19 19:49:22 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:22 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9" returned: 0 in 0.323s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62604c15-31c2-4d1e-8a8b-733519722da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75caeed8-1f24-4579-b87d-060bef476ce9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06179ada-5940-4818-ae21-bdb577b4b08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:22 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Volume volume-75caeed8-1f24-4579-b87d-060bef476ce9 (75caeed8-1f24-4579-b87d-060bef476ce9): created successfully
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06179ada-5940-4818-ae21-bdb577b4b08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Flow 'volume_create_manager' (e1a860fe-ca2d-43ce-99cf-949c97efeda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e4def403-9ebd-4e7c-9a44-5df87813d8af tempest-GroupSnapshotsV319Test-1049762430 None] Created volume successfully.
Jul 19 19:49:24 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] GroupSnapshot 1a3c22b0-6e52-4a39-9442-67e7025227fd: creating.
Jul 19 19:49:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Group snapshot 1a3c22b0-6e52-4a39-9442-67e7025227fd: creating. {{(pid=87353) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 19 19:49:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Creating offline snapshot 2941503e-1441-408b-a2b1-5ccd71c0238a of volume 75caeed8-1f24-4579-b87d-060bef476ce9 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:49:24 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ee1c3-82de-4f3f-8834-8ae54318464f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:24 devstack sudo[91769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9
Jul 19 19:49:24 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Flow 'volume_create_manager' (68b81a93-0d98-4c2f-8f8b-37aec737a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3637975-fa68-4bfe-bff7-5ce25a31f7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3637975-fa68-4bfe-bff7-5ce25a31f7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1292841556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4563204f-33ba-403e-80da-bb71e21a8d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ec854ca4504d6ca21553dfa7951036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:25Z,use_quota=True,user_id='8f6b320e58f5493291ab554a10d51a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87088814-6274-4eff-973f-74103f19b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87088814-6274-4eff-973f-74103f19b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4fb492-c93e-4a5f-a8e7-c386b8e4d6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4fb492-c93e-4a5f-a8e7-c386b8e4d6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4563204f-33ba-403e-80da-bb71e21a8d59', 'volume_name': 'volume-4563204f-33ba-403e-80da-bb71e21a8d59', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35756f8-4d9b-4611-89aa-40c24ce3253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35756f8-4d9b-4611-89aa-40c24ce3253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962080db-5d49-49aa-801c-4f79a172ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:25 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Volume 4563204f-33ba-403e-80da-bb71e21a8d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4563204f-33ba-403e-80da-bb71e21a8d59', 'volume_size': 1}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:25 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9" returned: 0 in 0.580s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:25 devstack sudo[91774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a 1G
Jul 19 19:49:25 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:25 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a 1G" returned: 0 in 0.498s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75caeed8-1f24-4579-b87d-060bef476ce9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:25 devstack sudo[91780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75caeed8-1f24-4579-b87d-060bef476ce9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a
Jul 19 19:49:25 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-cf0df521-b954-447b-9094-ad5039aaf919 req-00250231-7746-4920-beb2-cbb54a2f64ca tempest-AttachVolumeShelveTestJSON-179779931 None] No connector for attachment e619c019-99d3-42bd-849a-fe60ffe26e55; skipping storage backend terminate_connection call. {{(pid=87353) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 19 19:49:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-cf0df521-b954-447b-9094-ad5039aaf919 req-00250231-7746-4920-beb2-cbb54a2f64ca tempest-AttachVolumeShelveTestJSON-179779931 None] Deleting attachment e619c019-99d3-42bd-849a-fe60ffe26e55. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:49:26 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75caeed8-1f24-4579-b87d-060bef476ce9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a" returned: 0 in 0.370s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:26 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:49:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:26 devstack sudo[91818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a
Jul 19 19:49:26 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:26 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a" returned: 0 in 0.342s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:26 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.info
Jul 19 19:49:26 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:26 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.info" returned: 0 in 0.260s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:26 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:49:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:26 devstack sudo[91826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.info
Jul 19 19:49:26 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:27 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.info" returned: 0 in 0.270s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.897s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1292841556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4563204f-33ba-403e-80da-bb71e21a8d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ec854ca4504d6ca21553dfa7951036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:25Z,use_quota=True,user_id='8f6b320e58f5493291ab554a10d51a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Creating volume 4563204f-33ba-403e-80da-bb71e21a8d59 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:49:27 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:27 devstack sudo[91829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59 1073741824
Jul 19 19:49:27 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:27 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4c0fb297-be99-4e70-bce5-6059cd3c197e tempest-GroupSnapshotsV319Test-1049762430 None] group_snapshot 1a3c22b0-6e52-4a39-9442-67e7025227fd: created successfully
Jul 19 19:49:27 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59 1073741824" returned: 0 in 0.472s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:27 devstack sudo[91836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59
Jul 19 19:49:27 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:27 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59" returned: 0 in 0.337s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962080db-5d49-49aa-801c-4f79a172ca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4563204f-33ba-403e-80da-bb71e21a8d59', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187b3499-39cf-4a17-bce7-3de81cc78188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:27 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Volume volume-4563204f-33ba-403e-80da-bb71e21a8d59 (4563204f-33ba-403e-80da-bb71e21a8d59): created successfully
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187b3499-39cf-4a17-bce7-3de81cc78188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Flow 'volume_create_manager' (68b81a93-0d98-4c2f-8f8b-37aec737a713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:27 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ab99d82e-8148-47eb-bec0-e24a531baa91 tempest-AttachVolumeNegativeTest-664486592 None] Created volume successfully.
Jul 19 19:49:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] group_snapshot 1a3c22b0-6e52-4a39-9442-67e7025227fd: deleting
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] group_snapshot 1a3c22b0-6e52-4a39-9442-67e7025227fd: deleting {{(pid=87353) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Acquiring lock "cinder-quobyte-75caeed8-1f24-4579-b87d-060bef476ce9" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Lock "cinder-quobyte-75caeed8-1f24-4579-b87d-060bef476ce9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Acquiring lock "cinder-quobyte-2941503e-1441-408b-a2b1-5ccd71c0238a" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Lock "cinder-quobyte-2941503e-1441-408b-a2b1-5ccd71c0238a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Deleting offline snapshot 2941503e-1441-408b-a2b1-5ccd71c0238a of volume 75caeed8-1f24-4579-b87d-060bef476ce9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] snapshot_file for this snap is: volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0e4809-f40a-4e3f-acbb-f58178029ab1]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:28 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a
Jul 19 19:49:28 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:28 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a" returned: 0 in 0.394s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75caeed8-1f24-4579-b87d-060bef476ce9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7351b-5629-4200-932b-08b48db7f809]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:28 devstack sudo[91846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9
Jul 19 19:49:28 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:29 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9" returned: 0 in 0.447s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:29 devstack sudo[91853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a
Jul 19 19:49:29 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:29 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a" returned: 0 in 0.466s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:29 devstack sudo[91862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a
Jul 19 19:49:29 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:29 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9.2941503e-1441-408b-a2b1-5ccd71c0238a" returned: 0 in 0.273s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Lock "cinder-quobyte-2941503e-1441-408b-a2b1-5ccd71c0238a" released by "_delete_snapshot" :: held 1.698s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Lock "cinder-quobyte-75caeed8-1f24-4579-b87d-060bef476ce9" released by "delete_snapshot" :: held 1.727s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=59,cinder:UPDATE=64,cinder:DELETE=8,cinder:INSERT=17 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=79,cinder:SELECT=72,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:49:30 devstack cinder-volume[87353]: WARNING cinder.quota [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-763295197 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-763295197, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:49:30 devstack cinder-volume[87353]: WARNING cinder.quota [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-763295197 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-763295197, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] Created reservations ['6bc1ef0d-1c54-4746-a7f9-e9baef65ea61', '06037eb9-c60d-428b-bedf-ba3e416417cf', '030902b1-b02f-4bb9-a22e-c9a55a04560e', '79345324-f3b3-420a-9a9d-445bd9334d9e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2ba5a97d-ee2d-437e-b5b3-31f2c8b4458a tempest-GroupSnapshotsV319Test-1049762430 None] group_snapshot 1a3c22b0-6e52-4a39-9442-67e7025227fd: deleted successfully
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-36e788cf-135e-4223-8f01-3f63eadaa7c4 req-bba21bb6-b053-41e2-b6b6-1e15eb3048ba tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-36e788cf-135e-4223-8f01-3f63eadaa7c4 req-bba21bb6-b053-41e2-b6b6-1e15eb3048ba tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-36e788cf-135e-4223-8f01-3f63eadaa7c4 req-bba21bb6-b053-41e2-b6b6-1e15eb3048ba tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-36e788cf-135e-4223-8f01-3f63eadaa7c4 req-bba21bb6-b053-41e2-b6b6-1e15eb3048ba tempest-AttachVolumeNegativeTest-664486592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-4563204f-33ba-403e-80da-bb71e21a8d59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab726608-f378-49a3-9a9a-a8e17d9be258', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:49:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-36e788cf-135e-4223-8f01-3f63eadaa7c4 req-bba21bb6-b053-41e2-b6b6-1e15eb3048ba tempest-AttachVolumeNegativeTest-664486592 None] attachment_update completed successfully.
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Acquiring lock "cinder-quobyte-75caeed8-1f24-4579-b87d-060bef476ce9" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Lock "cinder-quobyte-75caeed8-1f24-4579-b87d-060bef476ce9" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:31 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eef1e5-f048-4393-9fcf-75a76cd7133e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:31 devstack sudo[91948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9
Jul 19 19:49:31 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:31 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9" returned: 0 in 0.471s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:31 devstack sudo[92269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9
Jul 19 19:49:31 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:31 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-75caeed8-1f24-4579-b87d-060bef476ce9" returned: 0 in 0.338s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Lock "cinder-quobyte-75caeed8-1f24-4579-b87d-060bef476ce9" released by "delete_volume" :: held 0.902s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:31 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Created reservations ['7496b66b-8bf1-4376-ace6-6804cd5928ac'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:31 devstack cinder-volume[87353]: WARNING cinder.quota [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-763295197 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-763295197, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Created reservations ['c69896e5-c4b4-43bc-a642-6d32ad3d7045', '1d6013fd-a317-4ea8-8baa-41781c52ca28', 'a14e45a5-1c0a-4d74-93b0-5eea09b78691', 'c7c108c6-9b72-4870-bda8-08e6d339c02d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:32 devstack sudo[92273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:32 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:32 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.336s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-51710124-018b-4da9-b2fd-5b94f86754c8 tempest-GroupSnapshotsV319Test-1049762430 None] Delete group completed successfully.
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:32 devstack sudo[92288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:32 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:33 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.615s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:49:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 8 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:49:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:49:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-bd9da7ac-28bd-4627-89d0-aea015e54f98 req-84f633e2-567d-4904-9c83-532ba87d9e7a tempest-AttachVolumeNegativeTest-664486592 None] Terminate volume connection completed successfully.
Jul 19 19:49:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-bd9da7ac-28bd-4627-89d0-aea015e54f98 req-84f633e2-567d-4904-9c83-532ba87d9e7a tempest-AttachVolumeNegativeTest-664486592 None] Deleting attachment ab726608-f378-49a3-9a9a-a8e17d9be258. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:49:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-a206a204-8a5e-41e3-b880-9ee8446481d1 req-cda07f9c-798e-4b94-9aa3-4b2f85f2ad8d tempest-ServerActionsTestOtherA-62752874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-a206a204-8a5e-41e3-b880-9ee8446481d1 req-cda07f9c-798e-4b94-9aa3-4b2f85f2ad8d tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-a206a204-8a5e-41e3-b880-9ee8446481d1 req-cda07f9c-798e-4b94-9aa3-4b2f85f2ad8d tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-a206a204-8a5e-41e3-b880-9ee8446481d1 req-cda07f9c-798e-4b94-9aa3-4b2f85f2ad8d tempest-ServerActionsTestOtherA-62752874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-43dad1f6-fea1-428d-b620-617d6a4a457a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '649160a1-134d-4cac-be2a-5d632f4eb96a', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:49:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-a206a204-8a5e-41e3-b880-9ee8446481d1 req-cda07f9c-798e-4b94-9aa3-4b2f85f2ad8d tempest-ServerActionsTestOtherA-62752874 None] attachment_update completed successfully.
Jul 19 19:49:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "cinder-4563204f-33ba-403e-80da-bb71e21a8d59-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-4563204f-33ba-403e-80da-bb71e21a8d59-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "cinder-quobyte-4563204f-33ba-403e-80da-bb71e21a8d59" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-quobyte-4563204f-33ba-403e-80da-bb71e21a8d59" acquired by "delete_volume" :: waited 0.052s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c145e4-20d2-44b5-b9a8-afb67788125d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:40 devstack sudo[92829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59
Jul 19 19:49:40 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:41 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59" returned: 0 in 0.501s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-07d85e71-f38b-4112-888c-202c2f6279d6 tempest-GroupsTest-1174786131 None] Group tempest-Group1-145728464: creating
Jul 19 19:49:41 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59
Jul 19 19:49:41 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-07d85e71-f38b-4112-888c-202c2f6279d6 tempest-GroupsTest-1174786131 None] Group tempest-Group1-145728464: created successfully
Jul 19 19:49:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-07d85e71-f38b-4112-888c-202c2f6279d6 tempest-GroupsTest-1174786131 None] Create group completed successfully.
Jul 19 19:49:41 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4563204f-33ba-403e-80da-bb71e21a8d59" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-quobyte-4563204f-33ba-403e-80da-bb71e21a8d59" released by "delete_volume" :: held 0.873s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Created reservations ['113bd068-d406-41db-b530-5f3cdeffc92b', '41540583-6050-46e4-bafc-60268c48a389', '9db364bd-6644-4187-ae19-6261beddba7c', 'e22ac911-86fc-48ea-9be6-4dd1785e4790'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:41 devstack sudo[92838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:41 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:42 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:42 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Deleted volume successfully.
Jul 19 19:49:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa6f0274-2cd7-48e8-9a74-9886fb0f7b6e tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-4563204f-33ba-403e-80da-bb71e21a8d59-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-cdd82dc5-c857-4e7d-b660-6abd40498804 tempest-GroupsTest-1174786131 None] Group tempest-Group2-1980584134: creating
Jul 19 19:49:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-cdd82dc5-c857-4e7d-b660-6abd40498804 tempest-GroupsTest-1174786131 None] Group tempest-Group2-1980584134: created successfully
Jul 19 19:49:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-cdd82dc5-c857-4e7d-b660-6abd40498804 tempest-GroupsTest-1174786131 None] Create group completed successfully.
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "cinder-ecc71005-a455-4da6-bf5f-0b2c5ab83a68-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-ecc71005-a455-4da6-bf5f-0b2c5ab83a68-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "cinder-quobyte-ecc71005-a455-4da6-bf5f-0b2c5ab83a68" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-quobyte-ecc71005-a455-4da6-bf5f-0b2c5ab83a68" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f64bef4-64ba-4a07-99fe-87929cc2217b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:43 devstack sudo[92846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68
Jul 19 19:49:43 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:43 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68" returned: 0 in 0.403s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:43 devstack sudo[92858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68
Jul 19 19:49:43 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:43 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-7f300126-45f2-4ebb-a51a-13c79eeafb66 req-0f388923-388f-4ee2-8345-25ca88a74e0d tempest-ServerActionsTestOtherA-62752874 None] Terminate volume connection completed successfully.
Jul 19 19:49:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-7f300126-45f2-4ebb-a51a-13c79eeafb66 req-0f388923-388f-4ee2-8345-25ca88a74e0d tempest-ServerActionsTestOtherA-62752874 None] Deleting attachment 649160a1-134d-4cac-be2a-5d632f4eb96a. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:49:44 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecc71005-a455-4da6-bf5f-0b2c5ab83a68" returned: 0 in 0.348s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-quobyte-ecc71005-a455-4da6-bf5f-0b2c5ab83a68" released by "delete_volume" :: held 0.840s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Created reservations ['a4c0f815-0141-4b2d-84bd-6e8d09a2face', 'c37ea461-96f6-4b13-a62f-182904bd50c6', '05c24ec4-fdc3-4028-b7dc-627a5f141bc3', '6d173025-6902-4069-995b-07e27d5c7ecb'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:44 devstack sudo[92902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:44 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Flow 'volume_create_manager' (bc357212-3662-4047-b286-500312795c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:44 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8181f8-1fa7-4c3e-8c0b-bb79b9582463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8181f8-1fa7-4c3e-8c0b-bb79b9582463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2084699545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a02d0600-7803-45b9-ba66-026c1aeed683,host='devstack@QuobyteHD#QuobyteHD',id=07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6ca71d3d3e4f43a80decffd048e8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:45Z,use_quota=True,user_id='6bbe95c5d7f44d95bc345c35fdcb5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30f5ad65-ea03-4353-9084-e24249a7a0f6),volume_type_id=30f5ad65-ea03-4353-9084-e24249a7a0f6)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0605aa57-4021-4053-99e4-a11fcdf00d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0605aa57-4021-4053-99e4-a11fcdf00d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757c33d7-00ad-437a-8dd7-604b14482601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757c33d7-00ad-437a-8dd7-604b14482601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5', 'volume_name': 'volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d29f62-21d5-4691-ac0a-5420cc6f24fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d29f62-21d5-4691-ac0a-5420cc6f24fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3d41a9-b63c-4f34-93f2-56fefcf3bae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:45 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Volume 07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5', 'volume_size': 1}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a02d0600-7803-45b9-ba66-026c1aeed683,created_at=2026-07-19T17:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2084699545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a02d0600-7803-45b9-ba66-026c1aeed683,host='devstack@QuobyteHD#QuobyteHD',id=07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6ca71d3d3e4f43a80decffd048e8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:45Z,use_quota=True,user_id='6bbe95c5d7f44d95bc345c35fdcb5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30f5ad65-ea03-4353-9084-e24249a7a0f6),volume_type_id=30f5ad65-ea03-4353-9084-e24249a7a0f6)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Creating volume 07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:49:45 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:45 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Deleted volume successfully.
Jul 19 19:49:45 devstack sudo[92916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5 1073741824
Jul 19 19:49:45 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d468ca94-ca5a-4ec3-ae37-b2c67f00ae4e tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-ecc71005-a455-4da6-bf5f-0b2c5ab83a68-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-7f300126-45f2-4ebb-a51a-13c79eeafb66 req-6b441d98-79f4-4693-b585-a3e50597020a tempest-ServerActionsTestOtherA-62752874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:45 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5 1073741824" returned: 0 in 0.553s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:45 devstack sudo[92925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5
Jul 19 19:49:45 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "cinder-42b028e8-320d-4611-982f-bc77fa882c2d-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-42b028e8-320d-4611-982f-bc77fa882c2d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "cinder-quobyte-42b028e8-320d-4611-982f-bc77fa882c2d" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-quobyte-42b028e8-320d-4611-982f-bc77fa882c2d" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32249a-cd6c-48bd-8f9d-d16529cce7ef]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:45 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-7f300126-45f2-4ebb-a51a-13c79eeafb66 req-6b441d98-79f4-4693-b585-a3e50597020a tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.648s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-7f300126-45f2-4ebb-a51a-13c79eeafb66 req-6b441d98-79f4-4693-b585-a3e50597020a tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:45 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3d41a9-b63c-4f34-93f2-56fefcf3bae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:45 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36593b72-4cde-4f33-86d5-cae8d8eae822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Volume volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5 (07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5): created successfully
Jul 19 19:49:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36593b72-4cde-4f33-86d5-cae8d8eae822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Flow 'volume_create_manager' (bc357212-3662-4047-b286-500312795c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-7f300126-45f2-4ebb-a51a-13c79eeafb66 req-6b441d98-79f4-4693-b585-a3e50597020a tempest-ServerActionsTestOtherA-62752874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-43dad1f6-fea1-428d-b620-617d6a4a457a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07c3a5da-5f09-408e-926f-77bf23c31750', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:49:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5f5f5155-3fdc-4f40-9705-d675f4785ae1 tempest-GroupsTest-1174786131 None] Created volume successfully.
Jul 19 19:49:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-7f300126-45f2-4ebb-a51a-13c79eeafb66 req-6b441d98-79f4-4693-b585-a3e50597020a tempest-ServerActionsTestOtherA-62752874 None] attachment_update completed successfully.
Jul 19 19:49:46 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d" returned: 0 in 0.530s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:46 devstack sudo[92934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d
Jul 19 19:49:46 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:46 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-42b028e8-320d-4611-982f-bc77fa882c2d" returned: 0 in 0.325s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-quobyte-42b028e8-320d-4611-982f-bc77fa882c2d" released by "delete_volume" :: held 0.900s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:46 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Created reservations ['0e1d1e72-ab2b-4532-b4a3-4485a2f1aa33', '6c5c581b-d865-4027-8173-ca9ea17cd6ec', '1f2bc6a1-3898-4ae1-93ec-0abd7f5dc5ff', '1acf505d-f95b-4c97-9130-81476be7ff46'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:47 devstack sudo[92941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:47 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Acquiring lock "cinder-quobyte-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Lock "cinder-quobyte-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faa19f1-ff06-4973-823b-a17562d1ab4b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:47 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.350s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Deleted volume successfully.
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c799b0f-cfaf-4022-98b6-791e2382f158 tempest-AttachVolumeNegativeTest-664486592 None] Lock "cinder-42b028e8-320d-4611-982f-bc77fa882c2d-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:47 devstack sudo[92954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5
Jul 19 19:49:47 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:47 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5" returned: 0 in 0.551s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:47 devstack sudo[93015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5
Jul 19 19:49:47 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:48 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5" returned: 0 in 0.516s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Lock "cinder-quobyte-07ea7f24-a8c4-46ca-a23a-050a8a1bb4a5" released by "delete_volume" :: held 1.124s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Created reservations ['d294c656-4567-4cf5-a203-83cec3011e8b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:48 devstack cinder-volume[87353]: WARNING cinder.quota [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2031106033 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2031106033, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:49:48 devstack cinder-volume[87353]: WARNING cinder.quota [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2031106033 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2031106033, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Created reservations ['a4f46587-a98c-43bc-a514-4ed60a99dc6b', '6ee214da-c4b9-4f0e-a999-a120641fe47b', '0c66db74-2c6d-4b42-ad62-c83324b2b690', '002509a8-5b9d-4f52-b69a-9385e79efd68'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:48 devstack sudo[93381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:48 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:49 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.417s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-cb371fa9-27f8-446d-9f17-6a0e020eea98 tempest-GroupsTest-1174786131 None] Delete group completed successfully.
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Created reservations ['cba64d5a-632c-458e-8735-dd901e7195a9'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:49 devstack sudo[93397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:49:49 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:50 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.464s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:50 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:49:50 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ae9b4d2c-eb3c-407f-8db2-ca252d249e05 tempest-GroupsTest-1174786131 None] Delete group completed successfully.
Jul 19 19:49:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-37ffba15-99b9-45fc-8feb-0c9daf657c55 tempest-GroupsTest-1174786131 None] Group tempest-GroupsTest-Group-1954497423: creating
Jul 19 19:49:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-37ffba15-99b9-45fc-8feb-0c9daf657c55 tempest-GroupsTest-1174786131 None] Group tempest-GroupsTest-Group-1954497423: created successfully
Jul 19 19:49:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-37ffba15-99b9-45fc-8feb-0c9daf657c55 tempest-GroupsTest-1174786131 None] Create group completed successfully.
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Flow 'volume_create_manager' (d19d40d2-380c-4bee-a446-9128ef2384c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16241e9c-80c5-4ff3-b26a-329a3066cb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16241e9c-80c5-4ff3-b26a-329a3066cb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-298697562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=29e75cdd-7d4e-47b6-b2cc-e0278657352a,host='devstack@QuobyteHD#QuobyteHD',id=04245230-3b40-426b-ae31-6c4b81a7b72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6ca71d3d3e4f43a80decffd048e8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:54Z,use_quota=True,user_id='6bbe95c5d7f44d95bc345c35fdcb5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd704cf-80db-40f4-b23f-1a1d9388a33f),volume_type_id=7fd704cf-80db-40f4-b23f-1a1d9388a33f)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f292810c-53a0-4c09-b7ee-f57105c1fe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f292810c-53a0-4c09-b7ee-f57105c1fe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8508c6f-f981-4f4a-b190-9940c1c99e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8508c6f-f981-4f4a-b190-9940c1c99e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04245230-3b40-426b-ae31-6c4b81a7b72d', 'volume_name': 'volume-04245230-3b40-426b-ae31-6c4b81a7b72d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48978da2-faaf-46b2-87af-8e7a0a012ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48978da2-faaf-46b2-87af-8e7a0a012ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81cf526-f175-4a2f-9a4b-65a2bb1a3352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:53 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Volume 04245230-3b40-426b-ae31-6c4b81a7b72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04245230-3b40-426b-ae31-6c4b81a7b72d', 'volume_size': 1}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=29e75cdd-7d4e-47b6-b2cc-e0278657352a,created_at=2026-07-19T17:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-298697562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=29e75cdd-7d4e-47b6-b2cc-e0278657352a,host='devstack@QuobyteHD#QuobyteHD',id=04245230-3b40-426b-ae31-6c4b81a7b72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6ca71d3d3e4f43a80decffd048e8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:54Z,use_quota=True,user_id='6bbe95c5d7f44d95bc345c35fdcb5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd704cf-80db-40f4-b23f-1a1d9388a33f),volume_type_id=7fd704cf-80db-40f4-b23f-1a1d9388a33f)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Creating volume 04245230-3b40-426b-ae31-6c4b81a7b72d {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:49:53 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:49:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:53 devstack sudo[93409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d 1073741824
Jul 19 19:49:53 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:54 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d 1073741824" returned: 0 in 0.500s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:54 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d
Jul 19 19:49:54 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:54 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d" returned: 0 in 0.275s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81cf526-f175-4a2f-9a4b-65a2bb1a3352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04245230-3b40-426b-ae31-6c4b81a7b72d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2db955-40ce-4706-ad26-29715ae75110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:54 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Volume volume-04245230-3b40-426b-ae31-6c4b81a7b72d (04245230-3b40-426b-ae31-6c4b81a7b72d): created successfully
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2db955-40ce-4706-ad26-29715ae75110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Flow 'volume_create_manager' (d19d40d2-380c-4bee-a446-9128ef2384c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:54 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7e350543-2cf4-4ec5-ba0f-c675cfa3415c tempest-GroupsTest-1174786131 None] Created volume successfully.
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Flow 'volume_create_manager' (7a117574-8e88-4fe1-b740-92525ecb34b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a2880c-2a22-486e-a3aa-359dbbc0b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a2880c-2a22-486e-a3aa-359dbbc0b59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1369661513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=29e75cdd-7d4e-47b6-b2cc-e0278657352a,host='devstack@QuobyteHD#QuobyteHD',id=ecfe026f-e825-414b-8f77-3b2ec4b8630d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6ca71d3d3e4f43a80decffd048e8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:56Z,use_quota=True,user_id='6bbe95c5d7f44d95bc345c35fdcb5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd704cf-80db-40f4-b23f-1a1d9388a33f),volume_type_id=7fd704cf-80db-40f4-b23f-1a1d9388a33f)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9587cf79-60d1-4231-833b-0825fa4a1130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9587cf79-60d1-4231-833b-0825fa4a1130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec109c6d-813c-4ca0-a80c-c3f74968d896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec109c6d-813c-4ca0-a80c-c3f74968d896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfe026f-e825-414b-8f77-3b2ec4b8630d', 'volume_name': 'volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e278ab-876b-4023-a175-0dd695ea7a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e278ab-876b-4023-a175-0dd695ea7a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f2fb51-c8d9-409d-ae32-6514bc52a89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:55 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Volume ecfe026f-e825-414b-8f77-3b2ec4b8630d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d', 'volume_size': 1}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=29e75cdd-7d4e-47b6-b2cc-e0278657352a,created_at=2026-07-19T17:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1369661513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=29e75cdd-7d4e-47b6-b2cc-e0278657352a,host='devstack@QuobyteHD#QuobyteHD',id=ecfe026f-e825-414b-8f77-3b2ec4b8630d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6ca71d3d3e4f43a80decffd048e8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:56Z,use_quota=True,user_id='6bbe95c5d7f44d95bc345c35fdcb5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd704cf-80db-40f4-b23f-1a1d9388a33f),volume_type_id=7fd704cf-80db-40f4-b23f-1a1d9388a33f)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Creating volume ecfe026f-e825-414b-8f77-3b2ec4b8630d {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:49:55 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:49:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:55 devstack sudo[93433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d 1073741824
Jul 19 19:49:55 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:56 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d 1073741824" returned: 0 in 0.458s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:56 devstack sudo[93439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d
Jul 19 19:49:56 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:56 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f2fb51-c8d9-409d-ae32-6514bc52a89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223d8710-9075-4af6-84fa-2fe94009df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:56 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Volume volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d (ecfe026f-e825-414b-8f77-3b2ec4b8630d): created successfully
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223d8710-9075-4af6-84fa-2fe94009df9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Flow 'volume_create_manager' (7a117574-8e88-4fe1-b740-92525ecb34b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-cc018635-09b9-4702-ba86-99bbcd64ab27 tempest-GroupsTest-1174786131 None] Created volume successfully.
Jul 19 19:49:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c915987f-03ae-4f58-8339-907b62763163 tempest-GroupsTest-1174786131 None] Update group completed successfully.
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Flow 'volume_create_manager' (4f99abe2-03ae-4227-8cac-5e483b78ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd306afd-ad1a-4e47-8a98-849792a41416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd306afd-ad1a-4e47-8a98-849792a41416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-803412583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b5f50d-cab8-4e56-8014-6fc9055865c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11b32e525f84379861f045e2dcef191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:58Z,use_quota=True,user_id='1e3bd4e64e9c4762b0c8df577f0ac07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c1fafc-32ad-4237-b863-047bd3c57bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c1fafc-32ad-4237-b863-047bd3c57bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2145b8-3651-40b3-b586-6bf867bb792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2145b8-3651-40b3-b586-6bf867bb792c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b5f50d-cab8-4e56-8014-6fc9055865c4', 'volume_name': 'volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca14f05d-8720-4f2b-bcb1-9720641f3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca14f05d-8720-4f2b-bcb1-9720641f3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec3347b-5ab7-46ef-a0e3-42bc624583dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:58 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Volume c5b5f50d-cab8-4e56-8014-6fc9055865c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4', 'volume_size': 1}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-803412583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b5f50d-cab8-4e56-8014-6fc9055865c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11b32e525f84379861f045e2dcef191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:49:58Z,use_quota=True,user_id='1e3bd4e64e9c4762b0c8df577f0ac07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Creating volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:49:58 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:58 devstack sudo[93442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 1073741824
Jul 19 19:49:58 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:58 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8361b290-feb7-4c93-bf8d-85d84169f1e4 tempest-GroupsTest-1174786131 None] Update group completed successfully.
Jul 19 19:49:58 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 1073741824" returned: 0 in 0.508s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:49:58 devstack sudo[93447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4
Jul 19 19:49:58 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:49:59 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root
Jul 19 19:49:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:49:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:49:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:49:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec3347b-5ab7-46ef-a0e3-42bc624583dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319f72a3-60ed-4943-a7a3-ec85894cafb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:49:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Volume volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 (c5b5f50d-cab8-4e56-8014-6fc9055865c4): created successfully
Jul 19 19:49:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319f72a3-60ed-4943-a7a3-ec85894cafb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:49:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Flow 'volume_create_manager' (4f99abe2-03ae-4227-8cac-5e483b78ec40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:49:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-604a10f0-42d0-4b10-8456-53e527a598d3 tempest-SnapshotsActionsTest-1541678169 None] Created volume successfully.
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Acquiring lock "cinder-quobyte-04245230-3b40-426b-ae31-6c4b81a7b72d" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Lock "cinder-quobyte-04245230-3b40-426b-ae31-6c4b81a7b72d" acquired by "delete_volume" :: waited 0.045s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[75796bfc-ccaa-488f-82fb-ac9131eb88a8]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Creating offline snapshot 2553847e-571a-40ba-b6cf-c1662a4d68af of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be99c9-ca4d-4040-b86e-4603597e50bb]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:00 devstack sudo[93452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d
Jul 19 19:50:00 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:00 devstack sudo[93453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4
Jul 19 19:50:00 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:01 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d" returned: 0 in 0.443s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:01 devstack sudo[93460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d
Jul 19 19:50:01 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:01 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4" returned: 0 in 0.510s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:01 devstack sudo[93465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af 1G
Jul 19 19:50:01 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:01 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-04245230-3b40-426b-ae31-6c4b81a7b72d" returned: 0 in 0.355s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Lock "cinder-quobyte-04245230-3b40-426b-ae31-6c4b81a7b72d" released by "delete_volume" :: held 0.857s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Acquiring lock "cinder-quobyte-ecfe026f-e825-414b-8f77-3b2ec4b8630d" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Lock "cinder-quobyte-ecfe026f-e825-414b-8f77-3b2ec4b8630d" acquired by "delete_volume" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a7513-4a9b-4ba0-9180-ee602f9c3643]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:01 devstack sudo[93472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d
Jul 19 19:50:01 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:01 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af 1G" returned: 0 in 0.442s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:01 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:01 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:01 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d" returned: 0 in 0.418s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:01 devstack sudo[93481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d
Jul 19 19:50:01 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:02 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.351s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:02 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af is being set with open permissions: ugo+rw
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:02 devstack sudo[93486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:02 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:02 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecfe026f-e825-414b-8f77-3b2ec4b8630d" returned: 0 in 0.268s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Lock "cinder-quobyte-ecfe026f-e825-414b-8f77-3b2ec4b8630d" released by "delete_volume" :: held 0.729s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Created reservations ['fdf7adfa-2c20-44a5-ba13-bdd83edb9936'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:02 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.269s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:02 devstack cinder-volume[87353]: WARNING cinder.quota [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-455193418 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-455193418, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:50:02 devstack cinder-volume[87353]: WARNING cinder.quota [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-455193418 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-455193418, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Created reservations ['018e7347-fdf0-47f6-aa79-013bbb7393c0', 'bf0b82b5-7e87-45ec-975e-792f8832f2b9', 'ffbee1fb-218a-4230-9fed-9808dd7c9861', 'f7caacad-9345-454e-96b1-c4b230b9a030'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:02 devstack sudo[93490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.info
Jul 19 19:50:02 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Created reservations ['73559c2c-5a37-4b69-b72b-bdbcadfc6173', '396dc85b-52b5-47b9-b7ca-e49a22fc5685', '283c4ef0-a8ad-4833-a21e-d505177675eb', '8727b285-2058-4ea2-9b6a-6086e1572116'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:02 devstack sudo[93493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:02 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:02 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.info" returned: 0 in 0.303s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:02 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.info is being set with open permissions: ugo+rw
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:02 devstack sudo[93495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.info
Jul 19 19:50:02 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:02 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.265s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5a5f3330-cd6a-4b1b-8e10-50c564655ac0 tempest-GroupsTest-1174786131 None] Delete group completed successfully.
Jul 19 19:50:02 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.info" returned: 0 in 0.258s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-882c76b2-f2cb-4e22-a19b-ddc0a8d95792 tempest-SnapshotsActionsTest-1541678169 None] Create snapshot completed successfully
Jul 19 19:50:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Creating offline snapshot 118558f8-94ca-41b9-9f8f-452e00d26ded of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:50:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d57c1c-9611-4217-b999-da399b6700e1]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:04 devstack sudo[93509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:04 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:05 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.580s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:05 devstack sudo[93565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded 1G
Jul 19 19:50:05 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:05 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded 1G" returned: 0 in 0.612s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:05 devstack sudo[93583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded
Jul 19 19:50:05 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:06 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded" returned: 0 in 0.316s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:06 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded is being set with open permissions: ugo+rw
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:06 devstack sudo[93588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded
Jul 19 19:50:06 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:06 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded" returned: 0 in 0.276s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:06 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-845feefc-fee3-4de0-8a5a-f59de10ef8fb tempest-SnapshotsActionsTest-1541678169 None] Create snapshot completed successfully
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-118558f8-94ca-41b9-9f8f-452e00d26ded-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-118558f8-94ca-41b9-9f8f-452e00d26ded-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-quobyte-118558f8-94ca-41b9-9f8f-452e00d26ded" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-118558f8-94ca-41b9-9f8f-452e00d26ded" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Deleting offline snapshot 118558f8-94ca-41b9-9f8f-452e00d26ded of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] snapshot_file for this snap is: volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518612d-47cb-4a6c-a5cc-8c1fffe39ccc]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:07 devstack sudo[93591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded
Jul 19 19:50:07 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:07 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded" returned: 0 in 0.372s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:07 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ca144a-7d23-4631-a32d-9ce60948ccdd]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:07 devstack sudo[93596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:07 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:07 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.369s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:07 devstack sudo[93601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded
Jul 19 19:50:07 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:08 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded" returned: 0 in 0.406s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:08 devstack sudo[93630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded
Jul 19 19:50:08 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:08 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.118558f8-94ca-41b9-9f8f-452e00d26ded" returned: 0 in 0.256s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-118558f8-94ca-41b9-9f8f-452e00d26ded" released by "_delete_snapshot" :: held 1.508s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" released by "delete_snapshot" :: held 1.532s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:08 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Created reservations ['7a26ec01-0dea-4658-a179-4d46d99b732a', 'af26b68f-2942-4339-8de4-3e5c3cc5e79d', '384d8d76-4a60-4215-bce6-6a5150f03a4d', '23e43ac5-0fe7-49cb-a822-55cbd2fbc133'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Delete snapshot completed successfully.
Jul 19 19:50:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c0854468-9c53-4628-b4c0-024b8e4f7d4a tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-118558f8-94ca-41b9-9f8f-452e00d26ded-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e263bc2c-3553-4c3e-8236-e8453067ead8 tempest-GroupsV320Test-1991851950 None] Group tempest-GroupsV320Test-Group-1351087030: creating
Jul 19 19:50:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e263bc2c-3553-4c3e-8236-e8453067ead8 tempest-GroupsV320Test-1991851950 None] Group tempest-GroupsV320Test-Group-1351087030: created successfully
Jul 19 19:50:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e263bc2c-3553-4c3e-8236-e8453067ead8 tempest-GroupsV320Test-1991851950 None] Create group completed successfully.
Jul 19 19:50:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Creating offline snapshot b3dea956-9e1d-4ff4-b29f-c70b426d0941 of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:50:09 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8f4a31-4740-438d-b800-f1a2f0e0438c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:09 devstack sudo[93633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:09 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:09 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.348s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:09 devstack sudo[93638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 1G
Jul 19 19:50:09 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:10 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 1G" returned: 0 in 0.445s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:10 devstack sudo[93644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941
Jul 19 19:50:10 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Created reservations ['27b4df20-2389-4dcd-be1e-a3d2cd15f3d5'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:10 devstack sudo[93646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:10 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:10 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941" returned: 0 in 0.302s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:10 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 is being set with open permissions: ugo+rw
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:10 devstack sudo[93651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941
Jul 19 19:50:10 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:10 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.246s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-af577d16-8c99-4440-a5a8-09841d76cbcb tempest-GroupsV320Test-1991851950 None] Delete group completed successfully.
Jul 19 19:50:10 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941" returned: 0 in 0.244s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.424s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-be5a5b14-355c-4d29-9a88-84817d0a3db6 tempest-SnapshotsActionsTest-1541678169 None] Create snapshot completed successfully
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-b3dea956-9e1d-4ff4-b29f-c70b426d0941-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-b3dea956-9e1d-4ff4-b29f-c70b426d0941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-quobyte-b3dea956-9e1d-4ff4-b29f-c70b426d0941" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-b3dea956-9e1d-4ff4-b29f-c70b426d0941" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Deleting offline snapshot b3dea956-9e1d-4ff4-b29f-c70b426d0941 of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] snapshot_file for this snap is: volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1123a4-7b48-4d9d-aa12-066667bc1de5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:11 devstack sudo[93655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941
Jul 19 19:50:11 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:12 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941" returned: 0 in 0.422s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad054182-d58c-4ff5-856f-e07af4a41a29]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:12 devstack sudo[93660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:12 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:12 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.415s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:12 devstack sudo[93666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941
Jul 19 19:50:12 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:12 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941" returned: 0 in 0.432s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:12 devstack sudo[93672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941
Jul 19 19:50:12 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:13 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.b3dea956-9e1d-4ff4-b29f-c70b426d0941" returned: 0 in 0.281s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-b3dea956-9e1d-4ff4-b29f-c70b426d0941" released by "_delete_snapshot" :: held 1.687s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" released by "delete_snapshot" :: held 1.710s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:13 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Created reservations ['e2ef2799-172d-44ea-9ca5-f960253f734e', 'd22febce-9980-4b6c-9d31-51c188170ac8', 'b99b12e8-cd48-401e-acb6-fcfe3f3e4cc4', '4c734e89-8724-494c-ad27-17abe6531011'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Delete snapshot completed successfully.
Jul 19 19:50:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4b435d70-c99c-4fab-9822-56e1209b73fa tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-b3dea956-9e1d-4ff4-b29f-c70b426d0941-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Creating offline snapshot 2f9e6676-5c28-4eec-af8d-2197a11cc067 of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:50:14 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0960dd05-cb31-46fa-a733-03fd12099bb1]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:14 devstack sudo[93678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:14 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:14 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.415s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:14 devstack sudo[93683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 1G
Jul 19 19:50:14 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:15 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 1G" returned: 0 in 0.562s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:15 devstack sudo[93689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067
Jul 19 19:50:15 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-37cb8bb1-d745-4d3c-af91-4489fc4f4a9e req-f1e3c229-1a10-4a47-90d1-d2c006ef6979 tempest-ServerActionsTestOtherA-62752874 None] Terminate volume connection completed successfully.
Jul 19 19:50:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-37cb8bb1-d745-4d3c-af91-4489fc4f4a9e req-f1e3c229-1a10-4a47-90d1-d2c006ef6979 tempest-ServerActionsTestOtherA-62752874 None] Deleting attachment 07c3a5da-5f09-408e-926f-77bf23c31750. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:50:15 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067" returned: 0 in 0.332s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:15 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 is being set with open permissions: ugo+rw
Jul 19 19:50:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:15 devstack sudo[93698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067
Jul 19 19:50:15 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:15 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067" returned: 0 in 0.280s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.704s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-53ab209a-e632-4072-af99-4fb59b2d2708 tempest-SnapshotsActionsTest-1541678169 None] Create snapshot completed successfully
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-2f9e6676-5c28-4eec-af8d-2197a11cc067-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-2f9e6676-5c28-4eec-af8d-2197a11cc067-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-quobyte-2f9e6676-5c28-4eec-af8d-2197a11cc067" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-2f9e6676-5c28-4eec-af8d-2197a11cc067" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Deleting offline snapshot 2f9e6676-5c28-4eec-af8d-2197a11cc067 of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] snapshot_file for this snap is: volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4756a4-6d7c-43b5-95e2-571fe4275a3e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:16 devstack sudo[93744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067
Jul 19 19:50:16 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:17 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067" returned: 0 in 0.765s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65a3c6c-a560-481f-b28b-48c1d85721df]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:17 devstack sudo[93781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:17 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:17 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.513s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:17 devstack sudo[93792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067
Jul 19 19:50:17 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:18 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067" returned: 0 in 0.527s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:18 devstack sudo[93802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067
Jul 19 19:50:18 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:18 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2f9e6676-5c28-4eec-af8d-2197a11cc067" returned: 0 in 0.443s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-2f9e6676-5c28-4eec-af8d-2197a11cc067" released by "_delete_snapshot" :: held 2.504s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" released by "delete_snapshot" :: held 2.537s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:19 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Created reservations ['03fa402b-33a9-459e-95d0-98f3f784ee40', '8dd3de4a-fef4-46dc-9d67-85924cc4edde', '8a916d56-1f2a-4016-b9fc-b7d5365a231e', '517312b2-b1f8-4086-bd58-6fdf0f9f8bae'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Delete snapshot completed successfully.
Jul 19 19:50:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9718c250-daba-4468-9e15-31c31245ebb6 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-2f9e6676-5c28-4eec-af8d-2197a11cc067-delete_snapshot" released by "delete_snapshot" :: held 2.778s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Creating offline snapshot f1546d2a-f0d9-48f7-a35a-15a757d361f9 of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:50:20 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[047a41a2-7b44-4f93-af94-9b07d298f2c0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:20 devstack sudo[93809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:20 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:20 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.415s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:20 devstack sudo[93814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 1G
Jul 19 19:50:20 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Acquiring lock "cinder-43dad1f6-fea1-428d-b620-617d6a4a457a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Lock "cinder-43dad1f6-fea1-428d-b620-617d6a4a457a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Acquiring lock "cinder-quobyte-43dad1f6-fea1-428d-b620-617d6a4a457a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Lock "cinder-quobyte-43dad1f6-fea1-428d-b620-617d6a4a457a" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6181f81-d675-4539-a139-c0549c724b27]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:21 devstack sudo[93820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a
Jul 19 19:50:21 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:21 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 1G" returned: 0 in 0.672s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:21 devstack sudo[93822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9
Jul 19 19:50:21 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:21 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a" returned: 0 in 0.508s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:21 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:21 devstack sudo[93832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9" returned: 0 in 0.320s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:21 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 is being set with open permissions: ugo+rw
Jul 19 19:50:21 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:21 devstack sudo[93834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9
Jul 19 19:50:21 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:21 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-43dad1f6-fea1-428d-b620-617d6a4a457a" returned: 0 in 0.284s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Lock "cinder-quobyte-43dad1f6-fea1-428d-b620-617d6a4a457a" released by "delete_volume" :: held 0.845s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Created reservations ['5d23874c-4035-4233-9faa-e95358821347', 'e45660fd-f797-4463-909b-bd2cb32dfbe1', '876558a3-48dd-4105-8f67-da0127ce612a', 'caa6d6ab-186c-4cf6-b952-21daae0a256e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:22 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9" returned: 0 in 0.349s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3df8a1be-c482-42e1-92e9-6a3caab44511 tempest-SnapshotsActionsTest-1541678169 None] Create snapshot completed successfully
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Acquiring lock "cinder-b499c908-65be-48ea-be3e-58d48913b67d-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:22 devstack sudo[93838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:22 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "cinder-b499c908-65be-48ea-be3e-58d48913b67d-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Acquiring lock "cinder-quobyte-b499c908-65be-48ea-be3e-58d48913b67d" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "cinder-quobyte-b499c908-65be-48ea-be3e-58d48913b67d" acquired by "delete_volume" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a02b5c0-6abc-4410-9d2e-0bd12337e12b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-f1546d2a-f0d9-48f7-a35a-15a757d361f9-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-f1546d2a-f0d9-48f7-a35a-15a757d361f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Acquiring lock "cinder-quobyte-f1546d2a-f0d9-48f7-a35a-15a757d361f9" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:22 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:22 devstack sudo[93840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d
Jul 19 19:50:22 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.403s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Deleted volume successfully.
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-f1546d2a-f0d9-48f7-a35a-15a757d361f9" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Deleting offline snapshot f1546d2a-f0d9-48f7-a35a-15a757d361f9 of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] snapshot_file for this snap is: volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8244677a-3a0a-47b8-af0b-eff71200941d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a22d03c2-61b4-401c-a0a5-be8314e027d5 tempest-ServerActionsTestOtherA-62752874 None] Lock "cinder-43dad1f6-fea1-428d-b620-617d6a4a457a-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:22 devstack sudo[93846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9
Jul 19 19:50:22 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:23 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d" returned: 0 in 0.693s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:23 devstack sudo[93866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d
Jul 19 19:50:23 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:23 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9" returned: 0 in 0.748s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e07c710-e6b4-42f8-845f-28ebcd81f5c3]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:23 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b499c908-65be-48ea-be3e-58d48913b67d" returned: 0 in 0.418s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "cinder-quobyte-b499c908-65be-48ea-be3e-58d48913b67d" released by "delete_volume" :: held 1.194s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:23 devstack sudo[93878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:23 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Created reservations ['e76a180e-42f9-4284-8d0a-0f52a435d343', 'fe3b053f-005f-4aad-a097-298ab939bf58', 'bbec804c-071d-4260-b298-22393912dcc2', '5686c9a7-0547-41eb-a828-bb6d522c5246'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:23 devstack sudo[93880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:23 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:23 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.521s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:24 devstack sudo[93886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9
Jul 19 19:50:24 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:24 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.358s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:24 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:24 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Deleted volume successfully.
Jul 19 19:50:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4e767757-4fa9-40ed-8e21-51010f0a1bbc tempest-AttachVolumeShelveTestJSON-179779931 None] Lock "cinder-b499c908-65be-48ea-be3e-58d48913b67d-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:24 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9" returned: 0 in 0.555s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:24 devstack sudo[93897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9
Jul 19 19:50:24 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:24 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.f1546d2a-f0d9-48f7-a35a-15a757d361f9" returned: 0 in 0.362s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-f1546d2a-f0d9-48f7-a35a-15a757d361f9" released by "_delete_snapshot" :: held 2.313s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" released by "delete_snapshot" :: held 2.388s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:25 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Created reservations ['8d9ed596-05b5-4657-bc80-66afd987e093', '57ee0d21-9dc3-4231-9563-546a9e486562', '766e65c8-df9f-4009-aea8-4859978358ae', '17d35a54-565f-427d-be79-add3ff7a3870'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Delete snapshot completed successfully.
Jul 19 19:50:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65d18c6d-529e-4f5f-9f01-3b82a496a8c1 tempest-SnapshotsActionsTest-780829881 None] Lock "cinder-f1546d2a-f0d9-48f7-a35a-15a757d361f9-delete_snapshot" released by "delete_snapshot" :: held 2.632s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "cinder-2553847e-571a-40ba-b6cf-c1662a4d68af-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-2553847e-571a-40ba-b6cf-c1662a4d68af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "cinder-quobyte-2553847e-571a-40ba-b6cf-c1662a4d68af" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-quobyte-2553847e-571a-40ba-b6cf-c1662a4d68af" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Deleting offline snapshot 2553847e-571a-40ba-b6cf-c1662a4d68af of volume c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] snapshot_file for this snap is: volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7061387-68a9-4b7c-90f8-c9ae90386343]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:26 devstack sudo[93902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:26 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Flow 'volume_create_manager' (9baa6e5d-b860-4fcd-9a4d-236b910bb9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd85a459-8f9a-4ef5-a6d7-7596699bb691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:26 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd85a459-8f9a-4ef5-a6d7-7596699bb691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1749835387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d571692-b50e-422d-8e63-eb04aec76929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8077bc65683a4de0a8e5441229a34512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:27Z,use_quota=True,user_id='407b79eabc634487a2cd42fcd6ec1a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46a111c-7e5b-4db0-8ec9-2f4c220034c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46a111c-7e5b-4db0-8ec9-2f4c220034c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1574f14d-4d17-4033-b738-03a8f4152b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1574f14d-4d17-4033-b738-03a8f4152b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d571692-b50e-422d-8e63-eb04aec76929', 'volume_name': 'volume-3d571692-b50e-422d-8e63-eb04aec76929', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d18c55-d8d4-461f-a3b3-5e225740b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d18c55-d8d4-461f-a3b3-5e225740b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17452c3-cda7-49bd-a527-87a0aac0052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:26 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Volume 3d571692-b50e-422d-8e63-eb04aec76929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d571692-b50e-422d-8e63-eb04aec76929', 'volume_size': 1}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1749835387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d571692-b50e-422d-8e63-eb04aec76929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8077bc65683a4de0a8e5441229a34512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:27Z,use_quota=True,user_id='407b79eabc634487a2cd42fcd6ec1a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Creating volume 3d571692-b50e-422d-8e63-eb04aec76929 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:50:27 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.582s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:27 devstack sudo[93907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929 1073741824
Jul 19 19:50:27 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc557b9-e4c6-447d-b191-7ca4f560ca92]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:27 devstack sudo[93909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4
Jul 19 19:50:27 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:27 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929 1073741824" returned: 0 in 0.535s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:27 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4" returned: 0 in 0.525s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:27 devstack sudo[93918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:27 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:27 devstack sudo[93920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929
Jul 19 19:50:27 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:27 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929" returned: 0 in 0.337s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17452c3-cda7-49bd-a527-87a0aac0052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d571692-b50e-422d-8e63-eb04aec76929', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be262a1b-9b3c-4872-b91d-951dd510c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:27 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.418s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:28 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Volume volume-3d571692-b50e-422d-8e63-eb04aec76929 (3d571692-b50e-422d-8e63-eb04aec76929): created successfully
Jul 19 19:50:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be262a1b-9b3c-4872-b91d-951dd510c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Flow 'volume_create_manager' (9baa6e5d-b860-4fcd-9a4d-236b910bb9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:28 devstack sudo[93927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af
Jul 19 19:50:28 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-862e0903-ea14-4536-ac44-39695ac9e7f6 tempest-VolumeQuotasAdminTestJSON-1897624083 None] Created volume successfully.
Jul 19 19:50:28 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4.2553847e-571a-40ba-b6cf-c1662a4d68af" returned: 0 in 0.348s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-quobyte-2553847e-571a-40ba-b6cf-c1662a4d68af" released by "_delete_snapshot" :: held 2.022s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" released by "delete_snapshot" :: held 2.058s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:28 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Created reservations ['2b902417-f409-4108-8190-e34a32928947', 'b990f22c-9a87-432a-b363-74191ae48c3e', 'a55992c0-9838-4bb4-ad1d-914152d1f437', '3a4b2362-5f4a-47d6-b299-52757cea1e9a'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Delete snapshot completed successfully.
Jul 19 19:50:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-26ae2512-ba02-46aa-890b-1a38c108566d tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-2553847e-571a-40ba-b6cf-c1662a4d68af-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Acquiring lock "cinder-3d571692-b50e-422d-8e63-eb04aec76929-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "cinder-3d571692-b50e-422d-8e63-eb04aec76929-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Acquiring lock "cinder-quobyte-3d571692-b50e-422d-8e63-eb04aec76929" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "cinder-quobyte-3d571692-b50e-422d-8e63-eb04aec76929" acquired by "delete_volume" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00e44f5-98cc-4dd1-9f99-1db82f36225c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:29 devstack sudo[93933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929
Jul 19 19:50:29 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "cinder-c5b5f50d-cab8-4e56-8014-6fc9055865c4-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-c5b5f50d-cab8-4e56-8014-6fc9055865c4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:29 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929" returned: 0 in 0.520s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" acquired by "delete_volume" :: waited 0.042s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:29 devstack sudo[93938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929
Jul 19 19:50:29 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f5ae25-69c7-4f79-82f8-3d44bc340a2f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:30 devstack sudo[93940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4
Jul 19 19:50:30 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:30 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d571692-b50e-422d-8e63-eb04aec76929" returned: 0 in 0.350s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "cinder-quobyte-3d571692-b50e-422d-8e63-eb04aec76929" released by "delete_volume" :: held 0.943s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=145,cinder:INSERT=32,cinder:UPDATE=158,cinder:DELETE=7 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=159,cinder:INSERT=39,cinder:UPDATE=142,cinder:DELETE=8 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Created reservations ['d1d64ee9-f6cb-4408-ad3d-24f7482548f8', 'b854876f-b51c-4e3f-ad39-efde48f4eae6', '90ef4ec0-e493-4f18-ac52-fcac3a13e6e0', '3003cf00-f9aa-48b4-a0d4-94f986e4a84c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:30 devstack sudo[93945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:30 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:30 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4" returned: 0 in 0.647s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:30 devstack sudo[93948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4
Jul 19 19:50:30 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:30 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.322s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Deleted volume successfully.
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f788b56a-72e3-43f5-80fd-1e85045aabbc tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "cinder-3d571692-b50e-422d-8e63-eb04aec76929-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:30 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5b5f50d-cab8-4e56-8014-6fc9055865c4" returned: 0 in 0.319s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-quobyte-c5b5f50d-cab8-4e56-8014-6fc9055865c4" released by "delete_volume" :: held 1.071s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Created reservations ['3bfc612c-e26a-4fba-947f-ab87f64048ef', '551b3407-ac00-474b-ae4f-bf63149be11c', '83f00eb9-3b6f-4feb-a0ef-cfa0d2878113', 'c4b95657-833d-4bf7-941d-8e51aad7e43c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:30 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:31 devstack sudo[93952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:31 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:31 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:31 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Deleted volume successfully.
Jul 19 19:50:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7f275f12-8c14-4117-83bf-3bf334663e3c tempest-SnapshotsActionsTest-1541678169 None] Lock "cinder-c5b5f50d-cab8-4e56-8014-6fc9055865c4-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Flow 'volume_create_manager' (d058fcea-de95-4681-80bd-62e4019e7f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee588e6-e752-461c-b5dd-9605fe7b5d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee588e6-e752-461c-b5dd-9605fe7b5d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-562528044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59169e00-5e6b-4278-82c4-7bb27b0cded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8077bc65683a4de0a8e5441229a34512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:32Z,use_quota=True,user_id='407b79eabc634487a2cd42fcd6ec1a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16855435-e6bf-437f-9842-9be96229e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16855435-e6bf-437f-9842-9be96229e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6babc6e-97bc-465e-9e33-87db8476abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6babc6e-97bc-465e-9e33-87db8476abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59169e00-5e6b-4278-82c4-7bb27b0cded0', 'volume_name': 'volume-59169e00-5e6b-4278-82c4-7bb27b0cded0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cee6bd-5ea7-46ad-a830-965abd539f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cee6bd-5ea7-46ad-a830-965abd539f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142180fd-4451-4801-9729-c970b40ebf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Volume 59169e00-5e6b-4278-82c4-7bb27b0cded0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59169e00-5e6b-4278-82c4-7bb27b0cded0', 'volume_size': 1}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-562528044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59169e00-5e6b-4278-82c4-7bb27b0cded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8077bc65683a4de0a8e5441229a34512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:32Z,use_quota=True,user_id='407b79eabc634487a2cd42fcd6ec1a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Creating volume 59169e00-5e6b-4278-82c4-7bb27b0cded0 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:50:32 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:32 devstack sudo[93962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0 1073741824
Jul 19 19:50:32 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:32 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0 1073741824" returned: 0 in 0.545s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:32 devstack sudo[93968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0
Jul 19 19:50:32 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:32 devstack sudo[93969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:32 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:33 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0" returned: 0 in 0.362s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142180fd-4451-4801-9729-c970b40ebf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59169e00-5e6b-4278-82c4-7bb27b0cded0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ec79f8-2f80-44d2-bb6c-03886f82aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Volume volume-59169e00-5e6b-4278-82c4-7bb27b0cded0 (59169e00-5e6b-4278-82c4-7bb27b0cded0): created successfully
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ec79f8-2f80-44d2-bb6c-03886f82aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:33 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Flow 'volume_create_manager' (d058fcea-de95-4681-80bd-62e4019e7f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.422s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 8 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:50:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:50:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-72f20502-7d88-4674-9222-0a5b7c29e37d tempest-VolumeQuotasAdminTestJSON-1897624083 None] Created volume successfully.
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Flow 'volume_create_manager' (b82dc8d0-1aec-4425-9be3-4ee5641a9797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9573061-c390-4861-a5f8-e658d2f62bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9573061-c390-4861-a5f8-e658d2f62bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-434402019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb70cab-7d88-439d-8115-2e24fa013216,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='46a4c1999dea4159ab0dcd24a028797d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:34Z,use_quota=True,user_id='0d92f079cbcb4479a46b40dfef78777e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95cae93-266c-4f20-97cc-9414b2884054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95cae93-266c-4f20-97cc-9414b2884054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8702fac8-317c-4f6b-b5e6-49d5199931eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8702fac8-317c-4f6b-b5e6-49d5199931eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb70cab-7d88-439d-8115-2e24fa013216', 'volume_name': 'volume-9eb70cab-7d88-439d-8115-2e24fa013216', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26804cab-4045-4a42-89d6-2cb5da86a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26804cab-4045-4a42-89d6-2cb5da86a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93da0c39-ccaa-4a65-afed-da813d4269d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Volume 9eb70cab-7d88-439d-8115-2e24fa013216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb70cab-7d88-439d-8115-2e24fa013216', 'volume_size': 1}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-434402019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb70cab-7d88-439d-8115-2e24fa013216,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='46a4c1999dea4159ab0dcd24a028797d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:34Z,use_quota=True,user_id='0d92f079cbcb4479a46b40dfef78777e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Creating volume 9eb70cab-7d88-439d-8115-2e24fa013216 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:50:34 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:34 devstack sudo[93975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216 1073741824
Jul 19 19:50:34 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:34 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216 1073741824" returned: 0 in 0.642s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:35 devstack sudo[93981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216
Jul 19 19:50:35 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:35 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216" returned: 0 in 0.324s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93da0c39-ccaa-4a65-afed-da813d4269d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb70cab-7d88-439d-8115-2e24fa013216', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156af43f-ffb1-4eac-b955-30eee53f9291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:35 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Volume volume-9eb70cab-7d88-439d-8115-2e24fa013216 (9eb70cab-7d88-439d-8115-2e24fa013216): created successfully
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156af43f-ffb1-4eac-b955-30eee53f9291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Flow 'volume_create_manager' (b82dc8d0-1aec-4425-9be3-4ee5641a9797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-3161ea49-e2f0-4bb3-a955-62c08d8f7893 req-9bdf04d4-3801-4234-ba1c-ccbb4d8be25f tempest-VolumesGetTestJSON-829296600 None] Created volume successfully.
Jul 19 19:50:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d2fe54e2-ba24-4edd-bbca-926750541bb1 tempest-VolumeQuotasAdminTestJSON-1639764553 None] Transfer volume completed successfully.
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Acquiring lock "cinder-59169e00-5e6b-4278-82c4-7bb27b0cded0-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Lock "cinder-59169e00-5e6b-4278-82c4-7bb27b0cded0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Acquiring lock "cinder-quobyte-59169e00-5e6b-4278-82c4-7bb27b0cded0" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Lock "cinder-quobyte-59169e00-5e6b-4278-82c4-7bb27b0cded0" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ad1062-38c7-46e8-8d33-09328ae58391]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:36 devstack sudo[93984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0
Jul 19 19:50:36 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:36 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0" returned: 0 in 0.432s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:36 devstack sudo[93990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0
Jul 19 19:50:36 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:36 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-59169e00-5e6b-4278-82c4-7bb27b0cded0" returned: 0 in 0.281s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Lock "cinder-quobyte-59169e00-5e6b-4278-82c4-7bb27b0cded0" released by "delete_volume" :: held 0.766s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Created reservations ['9d37cc44-dc60-4625-a39e-3ea71e22f816', '48224334-f216-49da-851f-01915ea14878', 'b052ca3f-c511-4288-bf5c-91a2dd09ff1c', 'ac2933ea-df5d-420c-8da9-3c6ac362422c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:37 devstack sudo[93993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:37 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Acquiring lock "cinder-9eb70cab-7d88-439d-8115-2e24fa013216-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Lock "cinder-9eb70cab-7d88-439d-8115-2e24fa013216-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:37 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.450s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Deleted volume successfully.
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Acquiring lock "cinder-quobyte-9eb70cab-7d88-439d-8115-2e24fa013216" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4561f4f5-01c2-4cb5-9b40-d972ae59274f tempest-VolumeQuotasAdminTestJSON-115152887 None] Lock "cinder-59169e00-5e6b-4278-82c4-7bb27b0cded0-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Lock "cinder-quobyte-9eb70cab-7d88-439d-8115-2e24fa013216" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f7036-929d-40bd-82fd-c4b08b85951c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:37 devstack sudo[93996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216
Jul 19 19:50:37 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:38 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216" returned: 0 in 0.492s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:38 devstack sudo[94001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216
Jul 19 19:50:38 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:38 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9eb70cab-7d88-439d-8115-2e24fa013216" returned: 0 in 0.320s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Lock "cinder-quobyte-9eb70cab-7d88-439d-8115-2e24fa013216" released by "delete_volume" :: held 0.883s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG cinder.quota [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Created reservations ['3db59d7a-343b-4ce2-85fb-a257eaad9833', '1630cd0b-482e-41ba-99d9-53ed0a502e8d', '03536d10-f195-44a0-a074-3cbd8036ed92', 'd760e803-a86a-450d-b327-563b4ee2bf63'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:38 devstack sudo[94004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:50:38 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:38 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.382s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG cinder.manager [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:50:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Deleted volume successfully.
Jul 19 19:50:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-9d291508-1390-4624-8b15-dd29c20f004e req-524157eb-2a84-4364-af5e-8773d6d7de67 tempest-VolumesGetTestJSON-829296600 None] Lock "cinder-9eb70cab-7d88-439d-8115-2e24fa013216-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:50:48 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:INSERT=7,cinder:UPDATE=35,cinder:SELECT=23 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:50:48 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=20,cinder:INSERT=11,cinder:UPDATE=39,cinder:DELETE=6 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Flow 'volume_create_manager' (025a740f-56ee-4789-a98a-861dd1d84d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ba2f35-582c-4582-9abb-4e8eea2cfb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ba2f35-582c-4582-9abb-4e8eea2cfb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1087049879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0814e9f4-f3d4-48ce-b391-031cd3d243c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428921bb544de6bc98b7ae1c4520eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:50Z,use_quota=True,user_id='af53316a3e50461baa4246e991e34c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905bebc7-a4b0-4215-abf6-ec3e32fe3521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905bebc7-a4b0-4215-abf6-ec3e32fe3521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6ab0e3-c0ba-47f8-a3c1-1fb867bc9424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6ab0e3-c0ba-47f8-a3c1-1fb867bc9424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0814e9f4-f3d4-48ce-b391-031cd3d243c9', 'volume_name': 'volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d634ff15-694c-4e30-9ca2-746050cf65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d634ff15-694c-4e30-9ca2-746050cf65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ce19b0-e690-48b0-98b8-29b7fdfd3eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:49 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Volume 0814e9f4-f3d4-48ce-b391-031cd3d243c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9', 'volume_size': 1}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1087049879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0814e9f4-f3d4-48ce-b391-031cd3d243c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428921bb544de6bc98b7ae1c4520eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:50Z,use_quota=True,user_id='af53316a3e50461baa4246e991e34c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Creating volume 0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:50:49 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:50:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:49 devstack sudo[94018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 1073741824
Jul 19 19:50:49 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:50 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 1073741824" returned: 0 in 0.590s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:50 devstack sudo[94034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9
Jul 19 19:50:50 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:51 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9" returned: 0 in 0.452s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:50:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ce19b0-e690-48b0-98b8-29b7fdfd3eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b507c66-ea53-4595-ac74-05077f1ff163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:51 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Volume volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 (0814e9f4-f3d4-48ce-b391-031cd3d243c9): created successfully
Jul 19 19:50:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b507c66-ea53-4595-ac74-05077f1ff163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Flow 'volume_create_manager' (025a740f-56ee-4789-a98a-861dd1d84d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b84c67e7-5877-499c-a56d-36e2a50ad6ab tempest-VolumesDeleteCascade-833718977 None] Created volume successfully.
Jul 19 19:50:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2e8fa10d-3ea5-473b-9713-41a55cbe99a3 tempest-GroupSnapshotsTest-1278955057 None] Group tempest-GroupSnapshotsTest-Group-1488098779: creating
Jul 19 19:50:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2e8fa10d-3ea5-473b-9713-41a55cbe99a3 tempest-GroupSnapshotsTest-1278955057 None] Group tempest-GroupSnapshotsTest-Group-1488098779: created successfully
Jul 19 19:50:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2e8fa10d-3ea5-473b-9713-41a55cbe99a3 tempest-GroupSnapshotsTest-1278955057 None] Create group completed successfully.
Jul 19 19:50:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Creating offline snapshot a21d6dc9-fab0-4ee9-84c1-fe216f7660dc of volume 0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:50:52 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cf8898-2e40-4125-b078-cdabe1c8a764]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:52 devstack sudo[94042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9
Jul 19 19:50:52 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:52 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9" returned: 0 in 0.492s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:52 devstack sudo[94048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc 1G
Jul 19 19:50:52 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Flow 'volume_create_manager' (69be0b05-f2e9-4858-8384-95fb462e3a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:53 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778b6c47-9b68-471c-9c30-853c71b13c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc 1G" returned: 0 in 0.603s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778b6c47-9b68-471c-9c30-853c71b13c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-602180757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b258f0c5-8c52-4130-8c1f-2e62431add3e,host='devstack@QuobyteHD#QuobyteHD',id=b7f0e09b-4daf-4988-9969-114c0f9da997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72133d9c10f4a29a7eb9a750619a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:53Z,use_quota=True,user_id='1857250344a047d6a1052091cdf2c219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e903bc55-36e0-4b79-8e15-1a53a6e109af),volume_type_id=e903bc55-36e0-4b79-8e15-1a53a6e109af)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c27d3b-8a49-47b0-9c96-de86730dc723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c27d3b-8a49-47b0-9c96-de86730dc723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a771bac9-0ea9-4ff3-84e1-919868ef2962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:53 devstack sudo[94055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc
Jul 19 19:50:53 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a771bac9-0ea9-4ff3-84e1-919868ef2962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f0e09b-4daf-4988-9969-114c0f9da997', 'volume_name': 'volume-b7f0e09b-4daf-4988-9969-114c0f9da997', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bd5d27-b4cf-481e-8c93-2c2470d287d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bd5d27-b4cf-481e-8c93-2c2470d287d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2a8970-4155-4258-9aef-8a9f947d4e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:53 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Volume b7f0e09b-4daf-4988-9969-114c0f9da997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f0e09b-4daf-4988-9969-114c0f9da997', 'volume_size': 1}
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:53 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" returned: 0 in 0.432s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:53 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc is being set with open permissions: ugo+rw
Jul 19 19:50:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:53 devstack sudo[94070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc
Jul 19 19:50:53 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:54 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" returned: 0 in 0.462s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:54 devstack sudo[94115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.info
Jul 19 19:50:54 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:55 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.info" returned: 0 in 0.664s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:55 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.info is being set with open permissions: ugo+rw
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:55 devstack sudo[94131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.info
Jul 19 19:50:55 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:55 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.info" returned: 0 in 0.366s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.177s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b258f0c5-8c52-4130-8c1f-2e62431add3e,created_at=2026-07-19T17:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-602180757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b258f0c5-8c52-4130-8c1f-2e62431add3e,host='devstack@QuobyteHD#QuobyteHD',id=b7f0e09b-4daf-4988-9969-114c0f9da997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72133d9c10f4a29a7eb9a750619a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:50:53Z,use_quota=True,user_id='1857250344a047d6a1052091cdf2c219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e903bc55-36e0-4b79-8e15-1a53a6e109af),volume_type_id=e903bc55-36e0-4b79-8e15-1a53a6e109af)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Creating volume b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:50:55 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:50:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:55 devstack sudo[94137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 1073741824
Jul 19 19:50:55 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:55 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b74660ba-2fb4-4a3f-a21a-4ec8d7505f7a tempest-VolumesDeleteCascade-833718977 None] Create snapshot completed successfully
Jul 19 19:50:56 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 1073741824" returned: 0 in 0.610s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:56 devstack sudo[94144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997
Jul 19 19:50:56 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:56 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997" returned: 0 in 0.290s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2a8970-4155-4258-9aef-8a9f947d4e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f0e09b-4daf-4988-9969-114c0f9da997', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f180fa-c2c2-40e3-844a-937ba93dd8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:50:56 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Volume volume-b7f0e09b-4daf-4988-9969-114c0f9da997 (b7f0e09b-4daf-4988-9969-114c0f9da997): created successfully
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f180fa-c2c2-40e3-844a-937ba93dd8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Flow 'volume_create_manager' (69be0b05-f2e9-4858-8384-95fb462e3a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:50:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-acb507e2-f951-4fa1-9409-614b951a57a0 tempest-GroupSnapshotsTest-1278955057 None] Created volume successfully.
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Creating offline snapshot 77f473be-5f7d-4e51-be48-ce54ef12bde1 of volume 0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6187641d-d697-4158-a851-5011858cf00a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:57 devstack sudo[94147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc
Jul 19 19:50:57 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:57 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" returned: 0 in 0.546s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:50:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:57 devstack sudo[94152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 1G
Jul 19 19:50:57 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:58 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] GroupSnapshot 856d0540-dae0-48f3-a71d-998d244a14a4: creating.
Jul 19 19:50:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Group snapshot 856d0540-dae0-48f3-a71d-998d244a14a4: creating. {{(pid=87353) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 19 19:50:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:50:58 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 1G" returned: 0 in 0.916s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:58 devstack sudo[94161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1
Jul 19 19:50:58 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:58 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1" returned: 0 in 0.556s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:58 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 is being set with open permissions: ugo+rw
Jul 19 19:50:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:58 devstack sudo[94167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1
Jul 19 19:50:58 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:50:59 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root
Jul 19 19:50:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1" returned: 0 in 0.359s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:50:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:50:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.163s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:50:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Creating offline snapshot 9ad1727e-6aa4-42b8-b2c0-3cbf93165206 of volume b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:50:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5f23981c-8128-4d1b-af7d-e33001f03f14 tempest-VolumesDeleteCascade-833718977 None] Create snapshot completed successfully
Jul 19 19:50:59 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9337d2-8fc8-40c9-95f8-b189fb910ddd]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:50:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:50:59 devstack sudo[94170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997
Jul 19 19:50:59 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-0814e9f4-f3d4-48ce-b391-031cd3d243c9-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-0814e9f4-f3d4-48ce-b391-031cd3d243c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Performing cascade delete. {{(pid=87353) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-77f473be-5f7d-4e51-be48-ce54ef12bde1-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-77f473be-5f7d-4e51-be48-ce54ef12bde1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-77f473be-5f7d-4e51-be48-ce54ef12bde1" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-77f473be-5f7d-4e51-be48-ce54ef12bde1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Deleting offline snapshot 77f473be-5f7d-4e51-be48-ce54ef12bde1 of volume 0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:51:00 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] snapshot_file for this snap is: volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997" returned: 0 in 0.994s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdf88e3-f89f-4870-9298-d90d4ae37ac0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:00 devstack sudo[94187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 1G
Jul 19 19:51:00 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:00 devstack sudo[94188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1
Jul 19 19:51:00 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:01 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1" returned: 0 in 0.707s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:01 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 1G" returned: 0 in 0.764s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f0e09b-4daf-4988-9969-114c0f9da997 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e1daa9-d270-468c-a5af-139ba32e982c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:01 devstack sudo[94204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f0e09b-4daf-4988-9969-114c0f9da997 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206
Jul 19 19:51:01 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:01 devstack sudo[94205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc
Jul 19 19:51:01 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:01 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f0e09b-4daf-4988-9969-114c0f9da997 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206" returned: 0 in 0.530s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:01 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:01 devstack sudo[94214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206
Jul 19 19:51:01 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:01 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" returned: 0 in 0.605s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:01 devstack sudo[94216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1
Jul 19 19:51:01 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:02 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206" returned: 0 in 0.372s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:02 devstack sudo[94219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.info
Jul 19 19:51:02 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:02 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1" returned: 0 in 0.744s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:02 devstack sudo[94224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1
Jul 19 19:51:02 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:02 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.info" returned: 0 in 0.546s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:02 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:51:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:02 devstack sudo[94227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.info
Jul 19 19:51:02 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:03 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.info" returned: 0 in 0.474s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:03 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.872s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.77f473be-5f7d-4e51-be48-ce54ef12bde1" returned: 0 in 0.678s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-77f473be-5f7d-4e51-be48-ce54ef12bde1" released by "_delete_snapshot" :: held 2.917s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" released by "delete_snapshot" :: held 2.976s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-566a0585-15d0-4242-a094-444a52d3674f tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 856d0540-dae0-48f3-a71d-998d244a14a4: created successfully
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Created reservations ['4fbe9868-02d1-4b4a-b343-2110d11984fb', '14a3bf43-6bf6-4bac-89cd-c6be22886155', 'd066c071-d4b8-47fc-b1d7-37ad93ae7e5d', '13597eef-ea0d-4c40-bee3-941280d84f66'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Delete snapshot completed successfully.
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-77f473be-5f7d-4e51-be48-ce54ef12bde1-delete_snapshot" released by "delete_snapshot" :: held 3.336s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-a21d6dc9-fab0-4ee9-84c1-fe216f7660dc-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-a21d6dc9-fab0-4ee9-84c1-fe216f7660dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Deleting offline snapshot a21d6dc9-fab0-4ee9-84c1-fe216f7660dc of volume 0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] snapshot_file for this snap is: volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad837bc7-fc05-4328-84e4-6d83980baaee]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:04 devstack sudo[94233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc
Jul 19 19:51:04 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:04 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" returned: 0 in 0.663s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb5133f-d439-4aa3-9dd0-b06bf5cd368f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:05 devstack sudo[94238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9
Jul 19 19:51:05 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-9ad1727e-6aa4-42b8-b2c0-3cbf93165206-15f82dfb-5494-409f-a6b0-a2fbefe030bb" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-9ad1727e-6aa4-42b8-b2c0-3cbf93165206-15f82dfb-5494-409f-a6b0-a2fbefe030bb" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Creating volume 15f82dfb-5494-409f-a6b0-a2fbefe030bb from snapshot 9ad1727e-6aa4-42b8-b2c0-3cbf93165206 {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-15f82dfb-5494-409f-a6b0-a2fbefe030bb" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-15f82dfb-5494-409f-a6b0-a2fbefe030bb" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] snapshot: 9ad1727e-6aa4-42b8-b2c0-3cbf93165206, volume: 15f82dfb-5494-409f-a6b0-a2fbefe030bb,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd7686b-1cfe-41d1-8c64-fdde1b9f9c5d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:05 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9" returned: 0 in 1.215s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:05 devstack sudo[94285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc
Jul 19 19:51:05 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:06 devstack sudo[94284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206
Jul 19 19:51:06 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:06 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" returned: 0 in 1.075s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:07 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206" returned: 0 in 1.207s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f0e09b-4daf-4988-9969-114c0f9da997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb1bbd3-c4fe-4f8e-8797-a98b0333be58]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:07 devstack sudo[94302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc
Jul 19 19:51:07 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:07 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9.a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" returned: 0 in 0.571s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:07 devstack sudo[94305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997
Jul 19 19:51:07 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-a21d6dc9-fab0-4ee9-84c1-fe216f7660dc" released by "_delete_snapshot" :: held 3.835s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" released by "delete_snapshot" :: held 3.916s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:07 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Created reservations ['9caff795-a31f-4dc4-b1df-422af4407c7d', '255d3c51-c225-43ce-bba3-8125b9169412', '4ccffdf1-9542-46e1-92a6-e359085a8c05', '479b2ccf-4d55-46e0-86a6-31de5f0d3945'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Delete snapshot completed successfully.
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-a21d6dc9-fab0-4ee9-84c1-fe216f7660dc-delete_snapshot" released by "delete_snapshot" :: held 4.443s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Snapshots deleted, issuing volume delete {{(pid=87353) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" acquired by "delete_volume" :: waited 0.059s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[db626b5f-100a-42eb-9687-875d1039fd34]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:08 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997" returned: 0 in 1.469s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 19:51:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:08 devstack sudo[94334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9
Jul 19 19:51:08 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:08 devstack sudo[94361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb
Jul 19 19:51:08 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:09 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9" returned: 0 in 0.798s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:09 devstack sudo[94370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9
Jul 19 19:51:09 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:09 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0814e9f4-f3d4-48ce-b391-031cd3d243c9" returned: 0 in 0.309s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-0814e9f4-f3d4-48ce-b391-031cd3d243c9" released by "delete_volume" :: held 1.291s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:09 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Created reservations ['f7606dee-65fd-4d0d-97ad-6dec11ab8142', '0917861a-c0b8-4a24-b370-0679d5ae3550', '44573c45-182c-4a48-91a6-9039175383dc', '18659028-7773-4779-bdfd-289ba777372c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:10 devstack sudo[94392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:10 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:11 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.870s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:11 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Deleted volume successfully.
Jul 19 19:51:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9b807c83-243b-4963-895a-4715c2eeade1 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-0814e9f4-f3d4-48ce-b391-031cd3d243c9-delete_volume" released by "delete_volume" :: held 10.881s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Flow 'volume_create_manager' (6003e120-e9e0-4b0e-a367-a34060d194a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2035bfaf-b78b-4055-9262-538e27b4910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2035bfaf-b78b-4055-9262-538e27b4910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2029710192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1395cc01-4f01-4016-ab25-d22fc23000c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428921bb544de6bc98b7ae1c4520eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:13Z,use_quota=True,user_id='af53316a3e50461baa4246e991e34c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d2063b-7a33-42bc-baac-2a5ecc459925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d2063b-7a33-42bc-baac-2a5ecc459925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27603816-916f-4b62-8405-0352f0a07fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27603816-916f-4b62-8405-0352f0a07fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1395cc01-4f01-4016-ab25-d22fc23000c5', 'volume_name': 'volume-1395cc01-4f01-4016-ab25-d22fc23000c5', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc4334d-a9e2-4245-a9de-ceba56b50504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc4334d-a9e2-4245-a9de-ceba56b50504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b70f12-5c89-4fff-a730-32719aae04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:13 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Volume 1395cc01-4f01-4016-ab25-d22fc23000c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1395cc01-4f01-4016-ab25-d22fc23000c5', 'volume_size': 1}
Jul 19 19:51:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Flow 'volume_create_manager' (62e8a822-d4c3-4c79-a408-989060e56cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b6cbe3-3484-403b-a8b5-edd882909e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b6cbe3-3484-403b-a8b5-edd882909e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-137968774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afac975-ac82-489b-8460-090f69183163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1b8069aafb4413800ea2906bf6bba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:14Z,use_quota=True,user_id='27450a9edcaf4a05b7cdc774230ee511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664e2b71-2706-4650-89ce-ff060c490487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664e2b71-2706-4650-89ce-ff060c490487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827547f8-5003-400a-be26-ed02d85fe25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827547f8-5003-400a-be26-ed02d85fe25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4afac975-ac82-489b-8460-090f69183163', 'volume_name': 'volume-4afac975-ac82-489b-8460-090f69183163', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea835e1-d54d-4f59-a589-6b09a40dcd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea835e1-d54d-4f59-a589-6b09a40dcd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74768988-36ab-4286-9e90-7012e8a0b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:14 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Volume 4afac975-ac82-489b-8460-090f69183163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4afac975-ac82-489b-8460-090f69183163', 'volume_size': 1}
Jul 19 19:51:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:16 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb" returned: 0 in 7.455s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d45363-520f-4344-9720-f132599e4bb9]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:16 devstack sudo[94428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997
Jul 19 19:51:16 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:16 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997" returned: 0 in 0.595s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:51:16 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Converted 1024.00 MB image at 137.33 MB/s
Jul 19 19:51:16 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:16 devstack sudo[94466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb
Jul 19 19:51:16 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:16 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-15f82dfb-5494-409f-a6b0-a2fbefe030bb" released by "_copy_volume_from_snapshot" :: held 11.328s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-9ad1727e-6aa4-42b8-b2c0-3cbf93165206-15f82dfb-5494-409f-a6b0-a2fbefe030bb" released by "_create_volume_from_snapshot" :: held 11.412s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.472s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.570s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2029710192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1395cc01-4f01-4016-ab25-d22fc23000c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428921bb544de6bc98b7ae1c4520eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:13Z,use_quota=True,user_id='af53316a3e50461baa4246e991e34c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Creating volume 1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:16 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:16 devstack sudo[94469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 1073741824
Jul 19 19:51:16 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ce1f245b-6d3f-464d-8e3f-3f6b8f587f0c tempest-GroupSnapshotsTest-1278955057 None] Create group from source-snapshot-856d0540-dae0-48f3-a71d-998d244a14a4 completed successfully.
Jul 19 19:51:17 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 1073741824" returned: 0 in 0.578s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:17 devstack sudo[94475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5
Jul 19 19:51:17 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-15f82dfb-5494-409f-a6b0-a2fbefe030bb" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-15f82dfb-5494-409f-a6b0-a2fbefe030bb" acquired by "delete_volume" :: waited 0.037s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:17 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5" returned: 0 in 0.385s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.460s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-137968774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afac975-ac82-489b-8460-090f69183163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1b8069aafb4413800ea2906bf6bba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:14Z,use_quota=True,user_id='27450a9edcaf4a05b7cdc774230ee511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Creating volume 4afac975-ac82-489b-8460-090f69183163 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:17 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dbad19-fe08-4511-abfd-c36ff72d5df0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:17 devstack sudo[94478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163 1073741824
Jul 19 19:51:17 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b70f12-5c89-4fff-a730-32719aae04de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1395cc01-4f01-4016-ab25-d22fc23000c5', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d46762c-de70-450c-8a4b-c06a72c3424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:18 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Volume volume-1395cc01-4f01-4016-ab25-d22fc23000c5 (1395cc01-4f01-4016-ab25-d22fc23000c5): created successfully
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d46762c-de70-450c-8a4b-c06a72c3424e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Flow 'volume_create_manager' (6003e120-e9e0-4b0e-a367-a34060d194a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:18 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-097ed0ed-0f9a-4fca-a698-129cc7a3e9e7 tempest-VolumesDeleteCascade-833718977 None] Created volume successfully.
Jul 19 19:51:18 devstack sudo[94480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb
Jul 19 19:51:18 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Flow 'volume_create_manager' (d8d670cd-d32c-446d-8e21-1847fdc07352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8e8673-2b4e-4905-bfe2-5350de63109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8e8673-2b4e-4905-bfe2-5350de63109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1738929449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da100535-2398-45dd-afa3-d45b8051d471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e759a5166cc48aa918ae6c24a1790ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:18Z,use_quota=True,user_id='c503658eb3d1458fb4cb48f43f604e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6deb1a64-165c-4629-a23f-f3c2b3847ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6deb1a64-165c-4629-a23f-f3c2b3847ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a0acb9-1dfc-4520-b5a6-837a494fa9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a0acb9-1dfc-4520-b5a6-837a494fa9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da100535-2398-45dd-afa3-d45b8051d471', 'volume_name': 'volume-da100535-2398-45dd-afa3-d45b8051d471', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b992bd5-2e56-45a6-9daf-813892020926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b992bd5-2e56-45a6-9daf-813892020926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a72a41f-5282-46af-a55c-16f05f8a5352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:18 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Volume da100535-2398-45dd-afa3-d45b8051d471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da100535-2398-45dd-afa3-d45b8051d471', 'volume_size': 1}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:18 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb" returned: 0 in 0.477s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:18 devstack sudo[94488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb
Jul 19 19:51:18 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:18 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163 1073741824" returned: 0 in 0.607s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:18 devstack sudo[94491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163
Jul 19 19:51:18 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:18 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15f82dfb-5494-409f-a6b0-a2fbefe030bb" returned: 0 in 0.264s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-15f82dfb-5494-409f-a6b0-a2fbefe030bb" released by "delete_volume" :: held 0.822s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['12d5848c-e7d7-4499-8c9b-943657da1af4'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:18 devstack cinder-volume[87353]: WARNING cinder.quota [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-71537272 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-71537272, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:51:18 devstack cinder-volume[87353]: WARNING cinder.quota [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-71537272 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-71537272, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['8abaffd9-fc35-4801-86c8-eec9cbfe830a', 'e61484d5-5bd3-420a-8f4d-2162b43d1970', 'b1ae5453-5065-4290-b47a-37c88c59695b', 'c1e8c22d-41a7-41f5-a1c7-2f8a72991637'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:18 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163" returned: 0 in 0.272s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1738929449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da100535-2398-45dd-afa3-d45b8051d471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e759a5166cc48aa918ae6c24a1790ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:18Z,use_quota=True,user_id='c503658eb3d1458fb4cb48f43f604e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Creating volume da100535-2398-45dd-afa3-d45b8051d471 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:18 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74768988-36ab-4286-9e90-7012e8a0b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4afac975-ac82-489b-8460-090f69183163', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:18 devstack sudo[94495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471 1073741824
Jul 19 19:51:18 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17f26fe-4829-4904-bf1a-f2a98426e3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:18 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Volume volume-4afac975-ac82-489b-8460-090f69183163 (4afac975-ac82-489b-8460-090f69183163): created successfully
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17f26fe-4829-4904-bf1a-f2a98426e3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Flow 'volume_create_manager' (62e8a822-d4c3-4c79-a408-989060e56cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:18 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0a1d83f1-b108-41c4-9ee2-c259cfd9f3fd tempest-VolumesListAdminTestJSON-1832335979 None] Created volume successfully.
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:19 devstack sudo[94497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:19 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 856d0540-dae0-48f3-a71d-998d244a14a4: deleting
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 856d0540-dae0-48f3-a71d-998d244a14a4: deleting {{(pid=87353) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-b7f0e09b-4daf-4988-9969-114c0f9da997" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-b7f0e09b-4daf-4988-9969-114c0f9da997" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-9ad1727e-6aa4-42b8-b2c0-3cbf93165206" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-9ad1727e-6aa4-42b8-b2c0-3cbf93165206" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Deleting offline snapshot 9ad1727e-6aa4-42b8-b2c0-3cbf93165206 of volume b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] snapshot_file for this snap is: volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:51:19 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ff320-bd8c-4935-ad80-d1904fc90221]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2028bf2e-e804-47d5-8e18-22b5b383b3c7 tempest-GroupSnapshotsTest-1278955057 None] Delete group completed successfully.
Jul 19 19:51:19 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471 1073741824" returned: 0 in 0.566s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:19 devstack sudo[94504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206
Jul 19 19:51:19 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:19 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471
Jul 19 19:51:19 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:19 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.279s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:19 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206" returned: 0 in 0.441s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f0e09b-4daf-4988-9969-114c0f9da997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Creating offline snapshot aa49a47a-bd99-4d09-b517-efdeca9331e5 of volume 1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eabad3-ef40-4bb1-90f1-ec29e408bf06]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a72a41f-5282-46af-a55c-16f05f8a5352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da100535-2398-45dd-afa3-d45b8051d471', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050b1697-6239-40d3-bff8-86afa8fc8cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caf127b-22bf-4369-923a-f13418f57a9d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:19 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Volume volume-da100535-2398-45dd-afa3-d45b8051d471 (da100535-2398-45dd-afa3-d45b8051d471): created successfully
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050b1697-6239-40d3-bff8-86afa8fc8cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Flow 'volume_create_manager' (d8d670cd-d32c-446d-8e21-1847fdc07352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-bb8cd222-5a95-4408-9f19-0ee4e86f88c4 tempest-ServersNegativeTestJSON-605619026 None] Created volume successfully.
Jul 19 19:51:19 devstack sudo[94513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5
Jul 19 19:51:19 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:20 devstack sudo[94512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997
Jul 19 19:51:20 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Flow 'volume_create_manager' (923d7247-62c3-4c81-b5bb-907d8c461e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9e6043-daf3-49c6-9e8a-d45ca4f1f4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9e6043-daf3-49c6-9e8a-d45ca4f1f4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1008578372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814862db-6158-487a-a64e-3f1279634a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1b8069aafb4413800ea2906bf6bba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:20Z,use_quota=True,user_id='27450a9edcaf4a05b7cdc774230ee511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde76892-b0e8-4eac-9603-7ef9e8895c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde76892-b0e8-4eac-9603-7ef9e8895c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d674a5-1706-4a76-8ddc-e094215fd779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d674a5-1706-4a76-8ddc-e094215fd779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814862db-6158-487a-a64e-3f1279634a92', 'volume_name': 'volume-814862db-6158-487a-a64e-3f1279634a92', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10528e0-44c0-4553-aaa3-ff716618efe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10528e0-44c0-4553-aaa3-ff716618efe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6856a58-4a1a-46d4-bb27-516769a285ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:20 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Volume 814862db-6158-487a-a64e-3f1279634a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814862db-6158-487a-a64e-3f1279634a92', 'volume_size': 1}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:20 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5" returned: 0 in 0.416s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:20 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997" returned: 0 in 0.467s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:20 devstack sudo[94522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 1G
Jul 19 19:51:20 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:20 devstack sudo[94523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206
Jul 19 19:51:20 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:20 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206" returned: 0 in 0.376s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:20 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 1G" returned: 0 in 0.441s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1395cc01-4f01-4016-ab25-d22fc23000c5 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:20 devstack sudo[94533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206
Jul 19 19:51:20 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:20 devstack sudo[94535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1395cc01-4f01-4016-ab25-d22fc23000c5 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5
Jul 19 19:51:20 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:20 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997.9ad1727e-6aa4-42b8-b2c0-3cbf93165206" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-9ad1727e-6aa4-42b8-b2c0-3cbf93165206" released by "_delete_snapshot" :: held 1.751s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-b7f0e09b-4daf-4988-9969-114c0f9da997" released by "delete_snapshot" :: held 1.786s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:21 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1395cc01-4f01-4016-ab25-d22fc23000c5 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5" returned: 0 in 0.332s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:21 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 is being set with open permissions: ugo+rw
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:21 devstack sudo[94542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5
Jul 19 19:51:21 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:21 devstack cinder-volume[87353]: WARNING cinder.quota [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-71537272 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-71537272, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['d717e056-81bb-44c1-816f-8a589152bfa7', 'ab566964-9165-4a6c-a216-fedc44411381', 'a0707f5f-8589-46ab-8bee-22ec1478ade0', '4ba0208e-f52e-4b5e-b807-07a149f55677'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:21 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-43dde211-35f3-48fd-b256-2ea5f07e3704 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 856d0540-dae0-48f3-a71d-998d244a14a4: deleted successfully
Jul 19 19:51:21 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5" returned: 0 in 0.295s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:21 devstack sudo[94545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.info
Jul 19 19:51:21 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:21 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.info" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:21 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.info is being set with open permissions: ugo+rw
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:21 devstack sudo[94548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.info
Jul 19 19:51:21 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Flow 'volume_create_manager' (0516dced-2221-4b26-900f-bd802576225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d586781-ea77-4f94-bb5c-7e924fe679e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-b7f0e09b-4daf-4988-9969-114c0f9da997" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d586781-ea77-4f94-bb5c-7e924fe679e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-611750467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c0fd22-213f-46ec-a915-d03f26038fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e759a5166cc48aa918ae6c24a1790ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:22Z,use_quota=True,user_id='c503658eb3d1458fb4cb48f43f604e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392dfad8-bb9b-4922-af6b-77bd4800e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392dfad8-bb9b-4922-af6b-77bd4800e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47243a49-3168-4890-a980-4be540aada20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47243a49-3168-4890-a980-4be540aada20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c0fd22-213f-46ec-a915-d03f26038fc3', 'volume_name': 'volume-a5c0fd22-213f-46ec-a915-d03f26038fc3', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64af71d-9e81-4052-b200-5c75829b1ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64af71d-9e81-4052-b200-5c75829b1ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0870f3e4-9d3d-4c7b-913f-cf3a04a1fefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:21 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Volume a5c0fd22-213f-46ec-a915-d03f26038fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c0fd22-213f-46ec-a915-d03f26038fc3', 'volume_size': 1}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-b7f0e09b-4daf-4988-9969-114c0f9da997" acquired by "delete_volume" :: waited 0.060s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:21 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.info" returned: 0 in 0.311s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f02a61c-636e-4663-a121-cb856e0f95be]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.873s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1008578372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814862db-6158-487a-a64e-3f1279634a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1b8069aafb4413800ea2906bf6bba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:20Z,use_quota=True,user_id='27450a9edcaf4a05b7cdc774230ee511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Creating volume 814862db-6158-487a-a64e-3f1279634a92 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:22 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:22 devstack sudo[94551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92 1073741824
Jul 19 19:51:22 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4df3db94-55a5-4730-8d73-0f885dfa3a72 tempest-VolumesDeleteCascade-833718977 None] Create snapshot completed successfully
Jul 19 19:51:22 devstack sudo[94552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997
Jul 19 19:51:22 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:22 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997" returned: 0 in 0.379s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:22 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92 1073741824" returned: 0 in 0.408s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:22 devstack sudo[94562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997
Jul 19 19:51:22 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:22 devstack sudo[94564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92
Jul 19 19:51:22 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:22 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b7f0e09b-4daf-4988-9969-114c0f9da997" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-b7f0e09b-4daf-4988-9969-114c0f9da997" released by "delete_volume" :: held 0.733s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:22 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.794s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-611750467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c0fd22-213f-46ec-a915-d03f26038fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e759a5166cc48aa918ae6c24a1790ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:22Z,use_quota=True,user_id='c503658eb3d1458fb4cb48f43f604e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Creating volume a5c0fd22-213f-46ec-a915-d03f26038fc3 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:22 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6856a58-4a1a-46d4-bb27-516769a285ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814862db-6158-487a-a64e-3f1279634a92', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:22 devstack sudo[94568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3 1073741824
Jul 19 19:51:22 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d9276e-6ad5-4d62-ad77-91d70b466e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:22 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Volume volume-814862db-6158-487a-a64e-3f1279634a92 (814862db-6158-487a-a64e-3f1279634a92): created successfully
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d9276e-6ad5-4d62-ad77-91d70b466e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Flow 'volume_create_manager' (923d7247-62c3-4c81-b5bb-907d8c461e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['9e240712-8c09-43c4-9e17-be37c1b8c345'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-89a6e4ae-67ca-4b62-a591-dfbf442c87a2 tempest-VolumesListAdminTestJSON-1832335979 None] Created volume successfully.
Jul 19 19:51:22 devstack cinder-volume[87353]: WARNING cinder.db.api [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-71537272']
Jul 19 19:51:22 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['f97f8f4d-634f-4b07-9252-7234196286fe', 'a3ad48ad-6a15-4e8b-9640-ff8ebeee6ebb', 'b003512e-d789-417c-8622-0f627f8f919c', '3c066449-ebda-49f2-81ae-eea8e3dce964'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:23 devstack sudo[94573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:23 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:23 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3 1073741824" returned: 0 in 0.570s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:23 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Flow 'volume_create_manager' (a75d8b77-3387-4f29-8d4e-76855f1d4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc403a6f-fb36-421e-96cf-a69ea57713fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:23 devstack sudo[94577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3
Jul 19 19:51:23 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.416s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7dafd60c-9589-4ea3-be6b-04822c588e6e tempest-GroupSnapshotsTest-1278955057 None] Delete group completed successfully.
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc403a6f-fb36-421e-96cf-a69ea57713fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1529051968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e769aca0-140f-4f76-9ced-7e5a64e88d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428921bb544de6bc98b7ae1c4520eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa49a47a-bd99-4d09-b517-efdeca9331e5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:23Z,use_quota=True,user_id='af53316a3e50461baa4246e991e34c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3477f49-e063-403b-ab03-2a89d8bd68c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3477f49-e063-403b-ab03-2a89d8bd68c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31634445-c0f9-4d32-9dac-96144a232f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31634445-c0f9-4d32-9dac-96144a232f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e769aca0-140f-4f76-9ced-7e5a64e88d4c', 'volume_name': 'volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c', 'volume_size': 1, 'snapshot_id': 'aa49a47a-bd99-4d09-b517-efdeca9331e5'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899fd77b-ebaa-4b25-87bb-7abea1cab377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899fd77b-ebaa-4b25-87bb-7abea1cab377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba9321d-0b04-406f-8c06-1c015a718950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:23 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Volume e769aca0-140f-4f76-9ced-7e5a64e88d4c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c', 'volume_size': 1, 'snapshot_id': 'aa49a47a-bd99-4d09-b517-efdeca9331e5'}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e4137858-1c5e-42c4-8a11-c38bd840ed7c tempest-GroupSnapshotsTest-1278955057 None] Group tempest-GroupSnapshotsTest-Group-390317944: creating
Jul 19 19:51:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e4137858-1c5e-42c4-8a11-c38bd840ed7c tempest-GroupSnapshotsTest-1278955057 None] Group tempest-GroupSnapshotsTest-Group-390317944: created successfully
Jul 19 19:51:23 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e4137858-1c5e-42c4-8a11-c38bd840ed7c tempest-GroupSnapshotsTest-1278955057 None] Create group completed successfully.
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3" returned: 0 in 0.340s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.213s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-aa49a47a-bd99-4d09-b517-efdeca9331e5-e769aca0-140f-4f76-9ced-7e5a64e88d4c" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0870f3e4-9d3d-4c7b-913f-cf3a04a1fefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c0fd22-213f-46ec-a915-d03f26038fc3', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44ac9c0-bfb8-4b4d-b02e-5b715a54c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-aa49a47a-bd99-4d09-b517-efdeca9331e5-e769aca0-140f-4f76-9ced-7e5a64e88d4c" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Creating volume e769aca0-140f-4f76-9ced-7e5a64e88d4c from snapshot aa49a47a-bd99-4d09-b517-efdeca9331e5 {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-e769aca0-140f-4f76-9ced-7e5a64e88d4c" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:23 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Volume volume-a5c0fd22-213f-46ec-a915-d03f26038fc3 (a5c0fd22-213f-46ec-a915-d03f26038fc3): created successfully
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44ac9c0-bfb8-4b4d-b02e-5b715a54c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Flow 'volume_create_manager' (0516dced-2221-4b26-900f-bd802576225b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-e769aca0-140f-4f76-9ced-7e5a64e88d4c" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] snapshot: aa49a47a-bd99-4d09-b517-efdeca9331e5, volume: e769aca0-140f-4f76-9ced-7e5a64e88d4c,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d41252be-e0e4-47a0-b5f3-2ff93a0d4c9d tempest-ServersNegativeTestJSON-605619026 None] Created volume successfully.
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29d2d4-e092-4005-95b0-11ecdfb95625]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Flow 'volume_create_manager' (c90c61d8-9d82-4d0d-b918-a8ebcfdd27d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c33b0d-7fcf-4dc3-b017-5c6b15104347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c33b0d-7fcf-4dc3-b017-5c6b15104347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1564914579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f614b4-0d95-4baa-a280-7a48471ce91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1b8069aafb4413800ea2906bf6bba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:24Z,use_quota=True,user_id='27450a9edcaf4a05b7cdc774230ee511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a57aa78-488b-4be9-9ad3-ad78dd6e6d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a57aa78-488b-4be9-9ad3-ad78dd6e6d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1262e8-933e-4167-8007-55fe792b0094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1262e8-933e-4167-8007-55fe792b0094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f614b4-0d95-4baa-a280-7a48471ce91a', 'volume_name': 'volume-e0f614b4-0d95-4baa-a280-7a48471ce91a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f4f409-da79-41e0-a220-20fc8fbe3589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:24 devstack sudo[94580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5
Jul 19 19:51:24 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f4f409-da79-41e0-a220-20fc8fbe3589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e34532-350a-439d-8863-f4f42128ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:24 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Volume e0f614b4-0d95-4baa-a280-7a48471ce91a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f614b4-0d95-4baa-a280-7a48471ce91a', 'volume_size': 1}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "cinder-a5c0fd22-213f-46ec-a915-d03f26038fc3-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Lock "cinder-a5c0fd22-213f-46ec-a915-d03f26038fc3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "cinder-quobyte-a5c0fd22-213f-46ec-a915-d03f26038fc3" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:24 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5" returned: 0 in 0.427s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1395cc01-4f01-4016-ab25-d22fc23000c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Lock "cinder-quobyte-a5c0fd22-213f-46ec-a915-d03f26038fc3" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b14142-4a26-4f06-90e9-2e1c13478d85]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[087aebcf-e6bb-4288-b781-a2e9ed5d192e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:24 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5
Jul 19 19:51:24 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:24 devstack sudo[94586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3
Jul 19 19:51:24 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:24 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5" returned: 0 in 0.373s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:24 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3" returned: 0 in 0.384s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:24 devstack sudo[94595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c
Jul 19 19:51:24 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:24 devstack sudo[94596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3
Jul 19 19:51:24 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:25 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a5c0fd22-213f-46ec-a915-d03f26038fc3" returned: 0 in 0.306s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Lock "cinder-quobyte-a5c0fd22-213f-46ec-a915-d03f26038fc3" released by "delete_volume" :: held 0.743s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Created reservations ['d8cf34f3-0a6b-4610-95f0-eb69c7b5e0b1', '8bf42ffa-d48a-4d16-b16e-73691c309edb', '4a445915-7941-4890-83e1-bab133c6ba6c', '6cce7ea9-9850-4b36-8e04-8d0343d968c0'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:25 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:25 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Flow 'volume_create_manager' (37fd5f00-208d-4594-bd55-33a1ebccf176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c00151c-4ddb-48c5-bdfa-0c687db21914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c00151c-4ddb-48c5-bdfa-0c687db21914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1556537944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df07a902-bec0-47a1-94f6-c81ce0421ae9,host='devstack@QuobyteHD#QuobyteHD',id=b62dc06f-f13a-4d57-bd8d-eae272b216cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72133d9c10f4a29a7eb9a750619a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:25Z,use_quota=True,user_id='1857250344a047d6a1052091cdf2c219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(932d3387-c378-4e49-8322-4076c4ecdf8b),volume_type_id=932d3387-c378-4e49-8322-4076c4ecdf8b)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9baf51b-7428-4405-ac56-d4c9de95d6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9baf51b-7428-4405-ac56-d4c9de95d6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fd8fbb-bbcb-45fb-8fa0-fb0b478ed626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fd8fbb-bbcb-45fb-8fa0-fb0b478ed626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62dc06f-f13a-4d57-bd8d-eae272b216cb', 'volume_name': 'volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518323f7-6bd1-4b8d-a5e5-31028e5d52b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518323f7-6bd1-4b8d-a5e5-31028e5d52b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaf0856-2eca-41f7-a49d-efa1cb9ec9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:25 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Volume b62dc06f-f13a-4d57-bd8d-eae272b216cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb', 'volume_size': 1}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "cinder-da100535-2398-45dd-afa3-d45b8051d471-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Lock "cinder-da100535-2398-45dd-afa3-d45b8051d471-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "cinder-quobyte-da100535-2398-45dd-afa3-d45b8051d471" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Lock "cinder-quobyte-da100535-2398-45dd-afa3-d45b8051d471" acquired by "delete_volume" :: waited 0.037s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:25 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.664s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Deleted volume successfully.
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5321c7f9-2841-492f-8f3e-aec2d6bd4564]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-01611825-569b-4267-97da-e85ce5d0b858 tempest-ServersNegativeTestJSON-605619026 None] Lock "cinder-a5c0fd22-213f-46ec-a915-d03f26038fc3-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:26 devstack sudo[94615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471
Jul 19 19:51:26 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:26 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471" returned: 0 in 0.793s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:26 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471
Jul 19 19:51:26 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:27 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-da100535-2398-45dd-afa3-d45b8051d471" returned: 0 in 0.537s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Lock "cinder-quobyte-da100535-2398-45dd-afa3-d45b8051d471" released by "delete_volume" :: held 1.435s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Created reservations ['12e2a40c-aad4-4691-8dd5-bad958e5b164', '2a7b8100-b890-4a2e-9f70-4f530c1c6ff1', 'c618be06-c551-4b2f-bdbe-6457d63460d0', 'd5dcad04-8325-4073-a9f4-fa72d0dadd1f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:27 devstack sudo[94625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:27 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:28 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.617s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:28 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Deleted volume successfully.
Jul 19 19:51:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77bf089c-a40c-47bd-bd59-48e43df539fc tempest-ServersNegativeTestJSON-605619026 None] Lock "cinder-da100535-2398-45dd-afa3-d45b8051d471-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:30 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c" returned: 0 in 5.619s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:30 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9828c7a-bb1f-4f4b-b791-b659a9a99fab]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:30 devstack sudo[94650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5
Jul 19 19:51:30 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:31 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5" returned: 0 in 0.673s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:51:31 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Converted 1024.00 MB image at 182.21 MB/s
Jul 19 19:51:31 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c is being set with open permissions: ugo+rw
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:31 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c
Jul 19 19:51:31 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:31 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c" returned: 0 in 0.269s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-e769aca0-140f-4f76-9ced-7e5a64e88d4c" released by "_copy_volume_from_snapshot" :: held 7.495s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-aa49a47a-bd99-4d09-b517-efdeca9331e5-e769aca0-140f-4f76-9ced-7e5a64e88d4c" released by "_create_volume_from_snapshot" :: held 7.549s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.580s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.297s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1564914579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f614b4-0d95-4baa-a280-7a48471ce91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1b8069aafb4413800ea2906bf6bba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:24Z,use_quota=True,user_id='27450a9edcaf4a05b7cdc774230ee511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Creating volume e0f614b4-0d95-4baa-a280-7a48471ce91a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:31 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:31 devstack sudo[94667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a 1073741824
Jul 19 19:51:31 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba9321d-0b04-406f-8c06-1c015a718950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c', 'volume_size': 1, 'snapshot_id': 'aa49a47a-bd99-4d09-b517-efdeca9331e5'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e364b58f-0cd2-4fe5-8bda-ec5339fb301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:31 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Volume volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c (e769aca0-140f-4f76-9ced-7e5a64e88d4c): created successfully
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e364b58f-0cd2-4fe5-8bda-ec5339fb301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Flow 'volume_create_manager' (a75d8b77-3387-4f29-8d4e-76855f1d4f81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-713d70b9-1de6-428b-b296-85bef5405c87 tempest-VolumesDeleteCascade-833718977 None] Created volume successfully.
Jul 19 19:51:31 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a 1073741824" returned: 0 in 0.414s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:31 devstack sudo[94673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a
Jul 19 19:51:31 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:32 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.432s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df07a902-bec0-47a1-94f6-c81ce0421ae9,created_at=2026-07-19T17:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1556537944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df07a902-bec0-47a1-94f6-c81ce0421ae9,host='devstack@QuobyteHD#QuobyteHD',id=b62dc06f-f13a-4d57-bd8d-eae272b216cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72133d9c10f4a29a7eb9a750619a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:25Z,use_quota=True,user_id='1857250344a047d6a1052091cdf2c219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(932d3387-c378-4e49-8322-4076c4ecdf8b),volume_type_id=932d3387-c378-4e49-8322-4076c4ecdf8b)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Creating volume b62dc06f-f13a-4d57-bd8d-eae272b216cb {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:32 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e34532-350a-439d-8863-f4f42128ea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f614b4-0d95-4baa-a280-7a48471ce91a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:32 devstack sudo[94676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb 1073741824
Jul 19 19:51:32 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fb1ddd-9c7f-4e46-9012-0932b7146f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Volume volume-e0f614b4-0d95-4baa-a280-7a48471ce91a (e0f614b4-0d95-4baa-a280-7a48471ce91a): created successfully
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fb1ddd-9c7f-4e46-9012-0932b7146f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Flow 'volume_create_manager' (c90c61d8-9d82-4d0d-b918-a8ebcfdd27d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-93e122e0-3a90-4a36-8ec9-93cf8146841e tempest-VolumesListAdminTestJSON-1832335979 None] Created volume successfully.
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-1395cc01-4f01-4016-ab25-d22fc23000c5-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-1395cc01-4f01-4016-ab25-d22fc23000c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Performing cascade delete. {{(pid=87353) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-aa49a47a-bd99-4d09-b517-efdeca9331e5-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-aa49a47a-bd99-4d09-b517-efdeca9331e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-1395cc01-4f01-4016-ab25-d22fc23000c5" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-1395cc01-4f01-4016-ab25-d22fc23000c5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-aa49a47a-bd99-4d09-b517-efdeca9331e5" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-aa49a47a-bd99-4d09-b517-efdeca9331e5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Deleting offline snapshot aa49a47a-bd99-4d09-b517-efdeca9331e5 of volume 1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] snapshot_file for this snap is: volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8732d809-d419-450b-9e69-4d6e905d330b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:32 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb 1073741824" returned: 0 in 0.509s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:32 devstack sudo[94683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb
Jul 19 19:51:32 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:32 devstack sudo[94682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5
Jul 19 19:51:32 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:32 devstack sudo[94687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:32 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:32 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb" returned: 0 in 0.272s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaf0856-2eca-41f7-a49d-efa1cb9ec9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a8305f-cdb0-4de0-a92e-bb2696e318c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Volume volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb (b62dc06f-f13a-4d57-bd8d-eae272b216cb): created successfully
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a8305f-cdb0-4de0-a92e-bb2696e318c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Flow 'volume_create_manager' (37fd5f00-208d-4594-bd55-33a1ebccf176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-65a4079f-8b08-47a6-8182-0f15d0b56b5d tempest-GroupSnapshotsTest-1278955057 None] Created volume successfully.
Jul 19 19:51:32 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5" returned: 0 in 0.477s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1395cc01-4f01-4016-ab25-d22fc23000c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c030b6c1-4071-4217-9433-b59b72713559]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:33 devstack sudo[94692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5
Jul 19 19:51:33 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:33 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.388s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 8 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:51:33 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5" returned: 0 in 0.479s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:33 devstack sudo[94699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5
Jul 19 19:51:33 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Flow 'volume_create_manager' (78d851d6-df07-4970-a2c2-6ff4179188bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06d5a67-8746-477d-b891-77df78e13263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06d5a67-8746-477d-b891-77df78e13263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=404532fe-42f0-474f-b0fe-718a130f3789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9254dd4d1e4b19a68a62d473af6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:34Z,use_quota=True,user_id='6bf317d82c9f40bb85e3b00096290cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d587d23-9ca4-4c9d-98ac-53fba869f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d587d23-9ca4-4c9d-98ac-53fba869f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d58dae1-0420-4796-addb-df39b26f4429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d58dae1-0420-4796-addb-df39b26f4429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '404532fe-42f0-474f-b0fe-718a130f3789', 'volume_name': 'volume-404532fe-42f0-474f-b0fe-718a130f3789', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b514e82-d22c-4442-8f93-183679cd9b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b514e82-d22c-4442-8f93-183679cd9b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91109a7-2095-4a5a-a6f7-37bfb03c592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Volume 404532fe-42f0-474f-b0fe-718a130f3789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-404532fe-42f0-474f-b0fe-718a130f3789', 'volume_size': 1}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=404532fe-42f0-474f-b0fe-718a130f3789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9254dd4d1e4b19a68a62d473af6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:34Z,use_quota=True,user_id='6bf317d82c9f40bb85e3b00096290cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Creating volume 404532fe-42f0-474f-b0fe-718a130f3789 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:33 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:33 devstack sudo[94703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789 1073741824
Jul 19 19:51:33 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:34 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Flow 'volume_create_manager' (e2c652c4-da29-43e5-a1b6-4f788b1b8941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01afffcf-13c4-46e3-aafc-b9f9bf34206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5" returned: 0 in 0.604s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:34 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01afffcf-13c4-46e3-aafc-b9f9bf34206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946431207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df07a902-bec0-47a1-94f6-c81ce0421ae9,host='devstack@QuobyteHD#QuobyteHD',id=278e214d-e0b6-44d3-9516-82cb88b4517f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72133d9c10f4a29a7eb9a750619a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:34Z,use_quota=True,user_id='1857250344a047d6a1052091cdf2c219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(932d3387-c378-4e49-8322-4076c4ecdf8b),volume_type_id=932d3387-c378-4e49-8322-4076c4ecdf8b)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:34 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42f48af-ddbe-418f-8155-a955d7400069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42f48af-ddbe-418f-8155-a955d7400069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd5e5f2-cf5b-46c7-8556-1c9cbc1db42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd5e5f2-cf5b-46c7-8556-1c9cbc1db42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278e214d-e0b6-44d3-9516-82cb88b4517f', 'volume_name': 'volume-278e214d-e0b6-44d3-9516-82cb88b4517f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0b18ac-cbe8-4555-8710-3cde75e38f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0b18ac-cbe8-4555-8710-3cde75e38f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68e07a9-bb9d-44e5-9f57-f8acbf7c35c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Volume 278e214d-e0b6-44d3-9516-82cb88b4517f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278e214d-e0b6-44d3-9516-82cb88b4517f', 'volume_size': 1}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:34 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789 1073741824" returned: 0 in 0.616s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:34 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5.aa49a47a-bd99-4d09-b517-efdeca9331e5" returned: 0 in 0.352s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-aa49a47a-bd99-4d09-b517-efdeca9331e5" released by "_delete_snapshot" :: held 2.033s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-1395cc01-4f01-4016-ab25-d22fc23000c5" released by "delete_snapshot" :: held 2.069s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:34 devstack sudo[94714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789
Jul 19 19:51:34 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Created reservations ['54c50ff0-bdd7-4098-b5ac-4df7ef736dcc', 'b0415e4f-d031-4037-8a0a-1dd3e3591485', 'd899b72c-5c0e-43ad-8855-53b027cf6b85', '45f4eece-0b71-451d-92ba-a7d91d79591f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Delete snapshot completed successfully.
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-aa49a47a-bd99-4d09-b517-efdeca9331e5-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Snapshots deleted, issuing volume delete {{(pid=87353) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-1395cc01-4f01-4016-ab25-d22fc23000c5" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-1395cc01-4f01-4016-ab25-d22fc23000c5" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d886b45b-0f2f-47e3-b183-4f7b4a37744f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:34 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789" returned: 0 in 0.299s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df07a902-bec0-47a1-94f6-c81ce0421ae9,created_at=2026-07-19T17:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946431207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df07a902-bec0-47a1-94f6-c81ce0421ae9,host='devstack@QuobyteHD#QuobyteHD',id=278e214d-e0b6-44d3-9516-82cb88b4517f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72133d9c10f4a29a7eb9a750619a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:34Z,use_quota=True,user_id='1857250344a047d6a1052091cdf2c219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(932d3387-c378-4e49-8322-4076c4ecdf8b),volume_type_id=932d3387-c378-4e49-8322-4076c4ecdf8b)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Creating volume 278e214d-e0b6-44d3-9516-82cb88b4517f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:34 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:34 devstack sudo[94717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91109a7-2095-4a5a-a6f7-37bfb03c592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-404532fe-42f0-474f-b0fe-718a130f3789', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:34 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:34 devstack sudo[94718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f 1073741824
Jul 19 19:51:34 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6581ea73-b621-42b3-a4e8-8e01c54bb244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Volume volume-404532fe-42f0-474f-b0fe-718a130f3789 (404532fe-42f0-474f-b0fe-718a130f3789): created successfully
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6581ea73-b621-42b3-a4e8-8e01c54bb244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Flow 'volume_create_manager' (78d851d6-df07-4970-a2c2-6ff4179188bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-36386881-4891-4731-973a-95ba93949c27 tempest-VolumesListAdminTestJSON-1215649167 None] Created volume successfully.
Jul 19 19:51:35 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5" returned: 0 in 0.416s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:35 devstack sudo[94728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5
Jul 19 19:51:35 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:35 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f 1073741824" returned: 0 in 0.502s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:35 devstack sudo[94730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f
Jul 19 19:51:35 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:35 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1395cc01-4f01-4016-ab25-d22fc23000c5" returned: 0 in 0.311s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-1395cc01-4f01-4016-ab25-d22fc23000c5" released by "delete_volume" :: held 0.793s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Created reservations ['18c131a5-c6a1-484b-abd7-486eed7ee2c2', '3c9c108e-ed55-4ab6-bc0c-6409bf2947e4', 'a0e20c8d-b2c6-4834-b3f1-b58940569e6b', '3c8a20c3-8fd0-4483-b075-b97007e5a6f5'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:35 devstack sudo[94734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:35 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:35 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f" returned: 0 in 0.275s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68e07a9-bb9d-44e5-9f57-f8acbf7c35c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278e214d-e0b6-44d3-9516-82cb88b4517f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c958dc-310a-4a07-99a5-9f9dd09b00f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:35 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Volume volume-278e214d-e0b6-44d3-9516-82cb88b4517f (278e214d-e0b6-44d3-9516-82cb88b4517f): created successfully
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c958dc-310a-4a07-99a5-9f9dd09b00f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Flow 'volume_create_manager' (e2c652c4-da29-43e5-a1b6-4f788b1b8941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-05129674-5f3b-4c23-a15c-2e5da1324cae tempest-GroupSnapshotsTest-1278955057 None] Created volume successfully.
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-e769aca0-140f-4f76-9ced-7e5a64e88d4c-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-e769aca0-140f-4f76-9ced-7e5a64e88d4c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:35 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.323s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:35 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Deleted volume successfully.
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "cinder-quobyte-e769aca0-140f-4f76-9ced-7e5a64e88d4c" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5c8422c6-6544-4c2d-aad0-1909ea7e356d tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-1395cc01-4f01-4016-ab25-d22fc23000c5-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-e769aca0-140f-4f76-9ced-7e5a64e88d4c" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Acquiring lock "cinder-404532fe-42f0-474f-b0fe-718a130f3789-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd816e-4af7-4513-99ab-d1294143f867]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "cinder-404532fe-42f0-474f-b0fe-718a130f3789-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Acquiring lock "cinder-quobyte-404532fe-42f0-474f-b0fe-718a130f3789" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "cinder-quobyte-404532fe-42f0-474f-b0fe-718a130f3789" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afe365a-8043-4ba1-b6d8-a07c274b8426]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:36 devstack sudo[94737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c
Jul 19 19:51:36 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "cinder-e0f614b4-0d95-4baa-a280-7a48471ce91a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-e0f614b4-0d95-4baa-a280-7a48471ce91a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "cinder-quobyte-e0f614b4-0d95-4baa-a280-7a48471ce91a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-quobyte-e0f614b4-0d95-4baa-a280-7a48471ce91a" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dce3f9e-fa15-4b58-a078-b5176a2f7109]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:36 devstack sudo[94738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789
Jul 19 19:51:36 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:36 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c" returned: 0 in 0.480s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:36 devstack sudo[94740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a
Jul 19 19:51:36 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:36 devstack sudo[94745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c
Jul 19 19:51:36 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:36 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789" returned: 0 in 0.608s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:36 devstack sudo[94751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789
Jul 19 19:51:36 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-36d907d0-2c08-44ab-a277-f8cf95c2c9a5 tempest-GroupSnapshotsTest-1278955057 None] Update group completed successfully.
Jul 19 19:51:36 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a" returned: 0 in 0.636s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:37 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e769aca0-140f-4f76-9ced-7e5a64e88d4c" returned: 0 in 0.482s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:37 devstack sudo[94757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a
Jul 19 19:51:37 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-quobyte-e769aca0-140f-4f76-9ced-7e5a64e88d4c" released by "delete_volume" :: held 1.025s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Created reservations ['f593c345-e71c-437e-935c-b9a1dbe5ea24', '6598e4a1-4e8a-4688-8193-0267c5d9f2bc', '22d35f28-8c57-4884-9732-cb926dc4fa98', '39a4d36b-217a-4b74-9770-414f9c3cf21b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:37 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-404532fe-42f0-474f-b0fe-718a130f3789" returned: 0 in 0.352s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "cinder-quobyte-404532fe-42f0-474f-b0fe-718a130f3789" released by "delete_volume" :: held 1.005s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Created reservations ['8b358f07-c1d4-48fd-9360-7669434c0d1e', '83367604-b3ed-4b03-b221-06ef2c10fc93', 'ff3f74bc-1be5-4ff0-a264-34b687eed6b2', '735cd450-51c7-4376-9e9f-1b73e138be09'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:37 devstack sudo[94760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:37 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:37 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e0f614b4-0d95-4baa-a280-7a48471ce91a" returned: 0 in 0.314s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-quobyte-e0f614b4-0d95-4baa-a280-7a48471ce91a" released by "delete_volume" :: held 1.013s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:37 devstack sudo[94763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:37 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Created reservations ['ee0446e3-da13-482f-9ea9-ff0f4cdc5186', '381990b7-8a20-48ff-8de5-cef854734532', 'eeeabd6e-2fc8-4ef5-8cd8-5fa19b44dea2', '4eef5e17-91f2-42d1-a0ab-643b6b770262'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:37 devstack sudo[94766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:37 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:37 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.323s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Deleted volume successfully.
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2008b29d-21b1-49e2-a47a-e7e5fe290b2e tempest-VolumesDeleteCascade-833718977 None] Lock "cinder-e769aca0-140f-4f76-9ced-7e5a64e88d4c-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:37 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.347s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Deleted volume successfully.
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-48275e35-3018-4b46-9fd5-442614698917 tempest-VolumesListAdminTestJSON-1215649167 None] Lock "cinder-404532fe-42f0-474f-b0fe-718a130f3789-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:37 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.414s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Deleted volume successfully.
Jul 19 19:51:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-867e8d5c-5ec7-4917-9613-6a3bf8df82e1 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-e0f614b4-0d95-4baa-a280-7a48471ce91a-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6dc8b115-ec9e-4915-af64-3a8f6ca28cc3 tempest-GroupSnapshotsTest-1278955057 None] Update group completed successfully.
Jul 19 19:51:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "cinder-814862db-6158-487a-a64e-3f1279634a92-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-814862db-6158-487a-a64e-3f1279634a92-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "cinder-quobyte-814862db-6158-487a-a64e-3f1279634a92" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-quobyte-814862db-6158-487a-a64e-3f1279634a92" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f1c4d6-2f99-44a2-a90d-19c5183356b7]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:38 devstack sudo[94771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92
Jul 19 19:51:38 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:39 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92" returned: 0 in 0.406s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:39 devstack sudo[94777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92
Jul 19 19:51:39 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c135999c-620c-48a9-b88a-97e089dfbc2f tempest-GroupSnapshotsTest-1278955057 None] Update group completed successfully.
Jul 19 19:51:39 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-814862db-6158-487a-a64e-3f1279634a92" returned: 0 in 0.341s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-quobyte-814862db-6158-487a-a64e-3f1279634a92" released by "delete_volume" :: held 0.791s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Created reservations ['e6b5ac10-7ad6-4700-81e4-40de2e92cc9f', '32d780ab-efb0-408e-b7ec-62afd59e68f9', '9505d34a-6a9c-4297-93c5-1f2ee959397d', 'a3da810b-00be-4011-8097-4cc43d9e272f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:39 devstack sudo[94780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:39 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "cinder-4afac975-ac82-489b-8460-090f69183163-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-4afac975-ac82-489b-8460-090f69183163-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "cinder-quobyte-4afac975-ac82-489b-8460-090f69183163" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-quobyte-4afac975-ac82-489b-8460-090f69183163" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[b720e69e-4186-4b72-b7f7-1f43f325614c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:40 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.457s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Deleted volume successfully.
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-87b745ed-8b0b-47db-abdb-d84f2f4870c5 tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-814862db-6158-487a-a64e-3f1279634a92-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:40 devstack sudo[94783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163
Jul 19 19:51:40 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:40 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163" returned: 0 in 0.494s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1d7d3e36-7630-4525-a1d6-474ca42e2e43 tempest-GroupSnapshotsTest-1278955057 None] Update group completed successfully.
Jul 19 19:51:40 devstack sudo[94788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163
Jul 19 19:51:40 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:40 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4afac975-ac82-489b-8460-090f69183163" returned: 0 in 0.273s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-quobyte-4afac975-ac82-489b-8460-090f69183163" released by "delete_volume" :: held 0.820s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:40 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Created reservations ['8cbb2114-9b97-4dd7-b88d-c9c050042c81', '100c9421-6df3-4050-82d4-30c174464e08', 'e44e4c1a-c0b6-4d09-8cd0-37b55baa6c2a', 'ef3c0947-6db5-44a6-b7ac-2db9fe15003c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:41 devstack sudo[94791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:41 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:41 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Deleted volume successfully.
Jul 19 19:51:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8fdd6304-e0e4-498a-9b91-af130e29840f tempest-VolumesListAdminTestJSON-1832335979 None] Lock "cinder-4afac975-ac82-489b-8460-090f69183163-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] GroupSnapshot 9f88802c-102a-4344-be67-f59a30428d85: creating.
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Group snapshot 9f88802c-102a-4344-be67-f59a30428d85: creating. {{(pid=87353) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Creating offline snapshot d064718f-d4fc-4078-a774-1959b1502f54 of volume b62dc06f-f13a-4d57-bd8d-eae272b216cb {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[17903519-3825-49de-ba38-84d3e9b89dcb]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:42 devstack sudo[94795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb
Jul 19 19:51:42 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Flow 'volume_create_manager' (76840017-fb0f-46d1-ae71-5d6f2ea6928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b80144a-5770-4d28-8d8f-09bfaf91287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b80144a-5770-4d28-8d8f-09bfaf91287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-569086615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97193524-e34b-4ad9-8837-7bcd7c767aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cfd4caf7a1434b8148a53b6f90dc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:42Z,use_quota=True,user_id='a64d3f7af4f143a4ad7afdcfa2ebb749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed842aeb-4b10-4b22-9d3b-e606d95eec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed842aeb-4b10-4b22-9d3b-e606d95eec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb55934e-1423-400a-b920-bb6d562ed270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb55934e-1423-400a-b920-bb6d562ed270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97193524-e34b-4ad9-8837-7bcd7c767aa2', 'volume_name': 'volume-97193524-e34b-4ad9-8837-7bcd7c767aa2', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9016f73-a2ce-4349-88d3-f1bfc188e742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9016f73-a2ce-4349-88d3-f1bfc188e742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6608d9f2-247a-4de1-a884-d0f2c45e648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:42 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Volume 97193524-e34b-4ad9-8837-7bcd7c767aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97193524-e34b-4ad9-8837-7bcd7c767aa2', 'volume_size': 1}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:42 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb" returned: 0 in 0.513s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:42 devstack sudo[94802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 1G
Jul 19 19:51:42 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:43 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 1G" returned: 0 in 0.532s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:43 devstack sudo[94808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54
Jul 19 19:51:43 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:43 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54" returned: 0 in 0.328s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:43 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:51:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:43 devstack sudo[94814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54
Jul 19 19:51:43 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:43 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54" returned: 0 in 0.261s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:43 devstack sudo[94817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.info
Jul 19 19:51:43 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:44 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.info" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:44 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:44 devstack sudo[94822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.info
Jul 19 19:51:44 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:44 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.info" returned: 0 in 0.324s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Creating offline snapshot e33f84f1-53ff-402d-b25e-96f394f8f07d of volume 278e214d-e0b6-44d3-9516-82cb88b4517f {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[b016a379-b812-4a70-9aba-d2ba014cf96c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:44 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f
Jul 19 19:51:44 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:44 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f" returned: 0 in 0.396s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:44 devstack sudo[94830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d 1G
Jul 19 19:51:44 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:45 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d 1G" returned: 0 in 0.585s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278e214d-e0b6-44d3-9516-82cb88b4517f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:45 devstack sudo[94835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278e214d-e0b6-44d3-9516-82cb88b4517f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d
Jul 19 19:51:45 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:45 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278e214d-e0b6-44d3-9516-82cb88b4517f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d" returned: 0 in 0.383s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:45 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:51:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:45 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d
Jul 19 19:51:45 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:46 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d" returned: 0 in 0.328s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:46 devstack sudo[94844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.info
Jul 19 19:51:46 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:46 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.info" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:46 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:46 devstack sudo[94847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.info
Jul 19 19:51:46 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:46 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.info" returned: 0 in 0.311s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.240s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-569086615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97193524-e34b-4ad9-8837-7bcd7c767aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cfd4caf7a1434b8148a53b6f90dc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:42Z,use_quota=True,user_id='a64d3f7af4f143a4ad7afdcfa2ebb749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Creating volume 97193524-e34b-4ad9-8837-7bcd7c767aa2 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:46 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:46 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2 1073741824
Jul 19 19:51:46 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-81304007-4929-4898-b7ec-9874b91693ef tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 9f88802c-102a-4344-be67-f59a30428d85: created successfully
Jul 19 19:51:47 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2 1073741824" returned: 0 in 0.614s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 9f88802c-102a-4344-be67-f59a30428d85: deleting
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 9f88802c-102a-4344-be67-f59a30428d85: deleting {{(pid=87353) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 19 19:51:47 devstack sudo[94856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2
Jul 19 19:51:47 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-b62dc06f-f13a-4d57-bd8d-eae272b216cb" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-b62dc06f-f13a-4d57-bd8d-eae272b216cb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-d064718f-d4fc-4078-a774-1959b1502f54" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-d064718f-d4fc-4078-a774-1959b1502f54" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Deleting offline snapshot d064718f-d4fc-4078-a774-1959b1502f54 of volume b62dc06f-f13a-4d57-bd8d-eae272b216cb {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] snapshot_file for this snap is: volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d9b645-369e-4d54-8ef0-f5dd8cf170fc]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:48 devstack sudo[94858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54
Jul 19 19:51:48 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:48 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2" returned: 0 in 0.489s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6608d9f2-247a-4de1-a884-d0f2c45e648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97193524-e34b-4ad9-8837-7bcd7c767aa2', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3ba32c-ec94-426d-92c4-d26c7f955364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:48 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Volume volume-97193524-e34b-4ad9-8837-7bcd7c767aa2 (97193524-e34b-4ad9-8837-7bcd7c767aa2): created successfully
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3ba32c-ec94-426d-92c4-d26c7f955364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Flow 'volume_create_manager' (76840017-fb0f-46d1-ae71-5d6f2ea6928a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:48 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c8f6afdd-70ea-4e66-9585-61ba16fb5f57 tempest-VolumesMetadataTest-183979282 None] Created volume successfully.
Jul 19 19:51:48 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54" returned: 0 in 0.602s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb53dea-625d-4433-9bc7-171c5cb736c3]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:48 devstack sudo[94864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb
Jul 19 19:51:48 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:49 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb" returned: 0 in 0.545s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:49 devstack sudo[94869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54
Jul 19 19:51:49 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:49 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54" returned: 0 in 0.535s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:49 devstack sudo[94875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54
Jul 19 19:51:49 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:49 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb.d064718f-d4fc-4078-a774-1959b1502f54" returned: 0 in 0.436s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-d064718f-d4fc-4078-a774-1959b1502f54" released by "_delete_snapshot" :: held 2.301s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-b62dc06f-f13a-4d57-bd8d-eae272b216cb" released by "delete_snapshot" :: held 2.352s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=175,cinder:SELECT=158,cinder:DELETE=9,cinder:INSERT=36 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Acquiring lock "cinder-97193524-e34b-4ad9-8837-7bcd7c767aa2-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-278e214d-e0b6-44d3-9516-82cb88b4517f" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Lock "cinder-97193524-e34b-4ad9-8837-7bcd7c767aa2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=149,cinder:INSERT=43,cinder:UPDATE=167,cinder:DELETE=16 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-278e214d-e0b6-44d3-9516-82cb88b4517f" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-e33f84f1-53ff-402d-b25e-96f394f8f07d" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-e33f84f1-53ff-402d-b25e-96f394f8f07d" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Deleting offline snapshot e33f84f1-53ff-402d-b25e-96f394f8f07d of volume 278e214d-e0b6-44d3-9516-82cb88b4517f {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] snapshot_file for this snap is: volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Acquiring lock "cinder-quobyte-97193524-e34b-4ad9-8837-7bcd7c767aa2" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1861c82-0bc1-4b62-bc80-8ff233768884]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Lock "cinder-quobyte-97193524-e34b-4ad9-8837-7bcd7c767aa2" acquired by "delete_volume" :: waited 0.033s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[11197f94-8ea4-4aec-8378-1487a11d85e9]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:50 devstack sudo[94878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d
Jul 19 19:51:50 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:50 devstack sudo[94879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2
Jul 19 19:51:50 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:50 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d" returned: 0 in 0.493s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-278e214d-e0b6-44d3-9516-82cb88b4517f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:51:50 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2" returned: 0 in 0.484s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3125fc3-1d22-43a7-9a9c-428bbcf99593]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:50 devstack sudo[94888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2
Jul 19 19:51:50 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:51 devstack sudo[94889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f
Jul 19 19:51:51 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:51 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-97193524-e34b-4ad9-8837-7bcd7c767aa2" returned: 0 in 0.360s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Lock "cinder-quobyte-97193524-e34b-4ad9-8837-7bcd7c767aa2" released by "delete_volume" :: held 0.908s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Created reservations ['a319d730-6e62-41b9-ba0e-b830b19a1f54', '67a6aa01-2b70-4ea2-a3aa-696ba7c9b50c', 'f8ac9124-19f7-4bda-86dd-029f513ca39c', 'eeed4961-e960-46d8-bc3c-13c321d28ca2'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:51 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f" returned: 0 in 0.522s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:51 devstack sudo[94897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d
Jul 19 19:51:51 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:51 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:51 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:51 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.294s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Deleted volume successfully.
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f63749ed-4ade-418b-bf9e-adcd8694f2e7 tempest-VolumesMetadataTest-183979282 None] Lock "cinder-97193524-e34b-4ad9-8837-7bcd7c767aa2-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:51 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d" returned: 0 in 0.446s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:51 devstack sudo[94906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d
Jul 19 19:51:51 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:52 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f.e33f84f1-53ff-402d-b25e-96f394f8f07d" returned: 0 in 0.300s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-e33f84f1-53ff-402d-b25e-96f394f8f07d" released by "_delete_snapshot" :: held 1.932s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-278e214d-e0b6-44d3-9516-82cb88b4517f" released by "delete_snapshot" :: held 1.989s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:52 devstack cinder-volume[87353]: WARNING cinder.quota [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1769919817 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1769919817, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:51:52 devstack cinder-volume[87353]: WARNING cinder.quota [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1769919817 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1769919817, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:51:52 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['3e609f61-a539-4bc7-939b-243816400e5c', '9b448e28-d34f-43ee-aaa2-80a5977cf60d', 'e590d78d-f2c5-4395-9a47-04de2ace5cff', 'c8f497a4-7b5d-4be1-b8b1-e6ff3c43ce13'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:52 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['92ee2688-125b-4701-b10c-6ce30ce2f547', 'a4d92d7f-985e-4db9-8179-42ca1045b005', 'b050914e-e001-4b9f-a54e-e1ed76fa0cc9', 'ceae6652-21ea-41c4-9f4b-76791226ab0c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:52 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-afa8fb1e-88f3-4d26-a21c-eadb463b05c6 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 9f88802c-102a-4344-be67-f59a30428d85: deleted successfully
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-278e214d-e0b6-44d3-9516-82cb88b4517f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-278e214d-e0b6-44d3-9516-82cb88b4517f" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed896713-4627-4bec-b1c7-15ccc1f9086f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:54 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f
Jul 19 19:51:54 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:54 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f" returned: 0 in 0.427s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:54 devstack sudo[94915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f
Jul 19 19:51:54 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:54 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-278e214d-e0b6-44d3-9516-82cb88b4517f" returned: 0 in 0.371s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-278e214d-e0b6-44d3-9516-82cb88b4517f" released by "delete_volume" :: held 0.899s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-b62dc06f-f13a-4d57-bd8d-eae272b216cb" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:51:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-b62dc06f-f13a-4d57-bd8d-eae272b216cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:51:55 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[45be7a0f-fd35-4cd7-85dd-bf9797d19e18]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:51:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:55 devstack sudo[94918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb
Jul 19 19:51:55 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:55 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb" returned: 0 in 0.476s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:55 devstack sudo[94923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb
Jul 19 19:51:55 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:55 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b62dc06f-f13a-4d57-bd8d-eae272b216cb" returned: 0 in 0.391s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-b62dc06f-f13a-4d57-bd8d-eae272b216cb" released by "delete_volume" :: held 0.957s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['7732dd52-23a3-4864-9e84-986a15f86d75'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:56 devstack cinder-volume[87353]: WARNING cinder.quota [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1769919817 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1769919817, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['56ab172a-a65a-44e6-aee4-5824dbe39fde', '75a62ffd-7d21-4112-a4eb-f080f6a2746b', '1e296907-1954-41e1-9e8e-721f1338c277', '4d8304bb-2275-46e0-af70-4c91c1e2551c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['aa5657c7-e6df-4d1c-a7ac-c1f881f56cc6', '60e9b1d0-2d66-4ec1-87c6-b9bc4052ce2b', 'b4479973-325e-484f-a63b-4a2c0b90b615', '0ee3f155-839c-4c31-83eb-2343d5f5478b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:56 devstack sudo[94929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:51:56 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:56 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.416s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:51:56 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:51:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e2bfccc6-fb20-4dc1-b714-bc8a6de1ed0a tempest-GroupSnapshotsTest-1278955057 None] Delete group completed successfully.
Jul 19 19:51:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6b997a39-9c1b-49a8-8058-b9999f0302b5 tempest-GroupSnapshotsTest-1278955057 None] Group tempest-GroupSnapshotsTest-Group-584892523: creating
Jul 19 19:51:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6b997a39-9c1b-49a8-8058-b9999f0302b5 tempest-GroupSnapshotsTest-1278955057 None] Group tempest-GroupSnapshotsTest-Group-584892523: created successfully
Jul 19 19:51:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6b997a39-9c1b-49a8-8058-b9999f0302b5 tempest-GroupSnapshotsTest-1278955057 None] Create group completed successfully.
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Flow 'volume_create_manager' (005890ce-fcaf-4c69-b241-78a8dd76e5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40933fb7-645c-4f6b-9f7f-667d13f10cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40933fb7-645c-4f6b-9f7f-667d13f10cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-178477126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3ca663-9452-4404-b436-1a5f3658980a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee666c0082fd46578a07de543ae67800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:59Z,use_quota=True,user_id='eca3368ba5874d1a8aec8512c96d988c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383e8045-8288-46e8-a8a2-1c14df767830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383e8045-8288-46e8-a8a2-1c14df767830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a767df-7bf9-4478-a627-672b3a09d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a767df-7bf9-4478-a627-672b3a09d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3ca663-9452-4404-b436-1a5f3658980a', 'volume_name': 'volume-6c3ca663-9452-4404-b436-1a5f3658980a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f121efba-a81a-4d42-83e3-10c859362793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f121efba-a81a-4d42-83e3-10c859362793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6915a6-c30a-45d8-a204-6a7fbda26fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Volume 6c3ca663-9452-4404-b436-1a5f3658980a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3ca663-9452-4404-b436-1a5f3658980a', 'volume_size': 1}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-178477126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3ca663-9452-4404-b436-1a5f3658980a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee666c0082fd46578a07de543ae67800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:59Z,use_quota=True,user_id='eca3368ba5874d1a8aec8512c96d988c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Creating volume 6c3ca663-9452-4404-b436-1a5f3658980a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:51:59 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Flow 'volume_create_manager' (67a4dd75-4669-4cb6-a566-69112f70d54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7da2ff-3d23-431d-a522-3572345a868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack sudo[94952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a 1073741824
Jul 19 19:51:59 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7da2ff-3d23-431d-a522-3572345a868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1986567796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b7b13dd8-1e76-4bc9-b5d2-ca49dc2427cc,host='devstack@QuobyteHD#QuobyteHD',id=f4bcccb9-8594-4690-bf39-432a8554b99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72133d9c10f4a29a7eb9a750619a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:59Z,use_quota=True,user_id='1857250344a047d6a1052091cdf2c219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98ff783-77ac-4724-9dad-efb00fe21485),volume_type_id=d98ff783-77ac-4724-9dad-efb00fe21485)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db5e56f-574f-40f1-98c5-ea5e206d7e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db5e56f-574f-40f1-98c5-ea5e206d7e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0720b9f2-d877-46d0-abac-facafbac169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0720b9f2-d877-46d0-abac-facafbac169d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bcccb9-8594-4690-bf39-432a8554b99f', 'volume_name': 'volume-f4bcccb9-8594-4690-bf39-432a8554b99f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f16795-c2be-4550-8feb-f6d0981e5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f16795-c2be-4550-8feb-f6d0981e5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8aec35c-a3d1-4015-98b7-c5708f7f3827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:51:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Volume f4bcccb9-8594-4690-bf39-432a8554b99f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bcccb9-8594-4690-bf39-432a8554b99f', 'volume_size': 1}
Jul 19 19:51:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:00 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a 1073741824" returned: 0 in 0.606s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:00 devstack sudo[94959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a
Jul 19 19:52:00 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:00 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a" returned: 0 in 0.282s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b7b13dd8-1e76-4bc9-b5d2-ca49dc2427cc,created_at=2026-07-19T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1986567796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b7b13dd8-1e76-4bc9-b5d2-ca49dc2427cc,host='devstack@QuobyteHD#QuobyteHD',id=f4bcccb9-8594-4690-bf39-432a8554b99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72133d9c10f4a29a7eb9a750619a89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:51:59Z,use_quota=True,user_id='1857250344a047d6a1052091cdf2c219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98ff783-77ac-4724-9dad-efb00fe21485),volume_type_id=d98ff783-77ac-4724-9dad-efb00fe21485)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Creating volume f4bcccb9-8594-4690-bf39-432a8554b99f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:52:00 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6915a6-c30a-45d8-a204-6a7fbda26fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3ca663-9452-4404-b436-1a5f3658980a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fb5e8f-7ad3-43c2-8d97-7eaa8f2db613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:00 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f 1073741824
Jul 19 19:52:00 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:00 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Volume volume-6c3ca663-9452-4404-b436-1a5f3658980a (6c3ca663-9452-4404-b436-1a5f3658980a): created successfully
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fb5e8f-7ad3-43c2-8d97-7eaa8f2db613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Flow 'volume_create_manager' (005890ce-fcaf-4c69-b241-78a8dd76e5bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-01ad8536-6a4c-40bb-a76c-3746b53be5b1 tempest-VolumesTransfersTest-2096052586 None] Created volume successfully.
Jul 19 19:52:01 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f 1073741824" returned: 0 in 0.899s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:01 devstack sudo[95028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f
Jul 19 19:52:01 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:01 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:52:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8aec35c-a3d1-4015-98b7-c5708f7f3827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bcccb9-8594-4690-bf39-432a8554b99f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c642adb5-fd8b-459a-a7c5-c22155841f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Volume volume-f4bcccb9-8594-4690-bf39-432a8554b99f (f4bcccb9-8594-4690-bf39-432a8554b99f): created successfully
Jul 19 19:52:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c642adb5-fd8b-459a-a7c5-c22155841f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Flow 'volume_create_manager' (67a4dd75-4669-4cb6-a566-69112f70d54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-921651f3-3c5b-431e-9edc-be1ac21c8707 tempest-GroupSnapshotsTest-1278955057 None] Created volume successfully.
Jul 19 19:52:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b1774d2e-912c-4800-a153-f1ee509be03b tempest-VolumesTransfersTest-875101310 None] Transfer volume completed successfully.
Jul 19 19:52:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] GroupSnapshot 007f01ea-a7dd-4c53-815d-85ca99742278: creating.
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Group snapshot 007f01ea-a7dd-4c53-815d-85ca99742278: creating. {{(pid=87353) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Creating offline snapshot 163996cf-f829-4e48-85b5-b666dd47c027 of volume f4bcccb9-8594-4690-bf39-432a8554b99f {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bcc08c-6105-4626-bd64-b9c6090b818b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Acquiring lock "cinder-6c3ca663-9452-4404-b436-1a5f3658980a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:03 devstack sudo[95044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f
Jul 19 19:52:03 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Lock "cinder-6c3ca663-9452-4404-b436-1a5f3658980a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Acquiring lock "cinder-quobyte-6c3ca663-9452-4404-b436-1a5f3658980a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Lock "cinder-quobyte-6c3ca663-9452-4404-b436-1a5f3658980a" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[50829155-1ff7-487c-83cf-f08e14e409aa]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:04 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a
Jul 19 19:52:04 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:04 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f" returned: 0 in 0.562s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:04 devstack sudo[95051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 1G
Jul 19 19:52:04 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:04 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a" returned: 0 in 0.548s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:04 devstack sudo[95056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a
Jul 19 19:52:04 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:05 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6c3ca663-9452-4404-b436-1a5f3658980a" returned: 0 in 0.524s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:05 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 1G" returned: 0 in 0.853s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bcccb9-8594-4690-bf39-432a8554b99f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Lock "cinder-quobyte-6c3ca663-9452-4404-b436-1a5f3658980a" released by "delete_volume" :: held 1.147s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:05 devstack sudo[95063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bcccb9-8594-4690-bf39-432a8554b99f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027
Jul 19 19:52:05 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Created reservations ['4b0bbcb9-2d1c-4c9a-b0a4-3e36752d41c8', '33f8e7b3-e72f-4d07-8dfd-d0b79dd4fe0f', '170a8c02-b3d8-4e37-a2d1-6dc0cc73187c', 'f76c745c-9e1f-4d73-a44f-a87cfd8db4b3'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:05 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:52:05 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:05 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bcccb9-8594-4690-bf39-432a8554b99f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027" returned: 0 in 0.634s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:05 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:05 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027
Jul 19 19:52:05 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:05 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.518s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:52:05 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Deleted volume successfully.
Jul 19 19:52:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b1f62b4a-d746-4b4d-a886-14061ca6f40e tempest-VolumesTransfersTest-2134126381 None] Lock "cinder-6c3ca663-9452-4404-b436-1a5f3658980a-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:06 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027" returned: 0 in 0.466s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:06 devstack sudo[95075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.info
Jul 19 19:52:06 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:06 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.info" returned: 0 in 0.661s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:06 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:52:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:06 devstack sudo[95084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.info
Jul 19 19:52:06 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:52:07 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Flow 'volume_create_manager' (01a1360e-399e-4ad9-a592-8f05f513f097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cecdb5b-3212-4969-aa92-411aaa0e3581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.info" returned: 0 in 0.504s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.830s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cecdb5b-3212-4969-aa92-411aaa0e3581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1667598235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0081363e-85a4-401e-911b-05bf89615352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee666c0082fd46578a07de543ae67800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:07Z,use_quota=True,user_id='eca3368ba5874d1a8aec8512c96d988c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd630401-a433-40f7-a2af-7b5eae5b6d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd630401-a433-40f7-a2af-7b5eae5b6d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafe46ed-e80e-45a5-a535-f01c47d127e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafe46ed-e80e-45a5-a535-f01c47d127e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0081363e-85a4-401e-911b-05bf89615352', 'volume_name': 'volume-0081363e-85a4-401e-911b-05bf89615352', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0215514b-d456-440f-976d-c607ed4a3c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0215514b-d456-440f-976d-c607ed4a3c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3131efd3-b88a-45d8-84a2-62c97bfc993c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:07 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Volume 0081363e-85a4-401e-911b-05bf89615352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0081363e-85a4-401e-911b-05bf89615352', 'volume_size': 1}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1667598235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0081363e-85a4-401e-911b-05bf89615352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee666c0082fd46578a07de543ae67800',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:07Z,use_quota=True,user_id='eca3368ba5874d1a8aec8512c96d988c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Creating volume 0081363e-85a4-401e-911b-05bf89615352 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:52:07 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:52:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:07 devstack sudo[95091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352 1073741824
Jul 19 19:52:07 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:07 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f6a28e45-483c-43e3-89c5-1729e0f5f328 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 007f01ea-a7dd-4c53-815d-85ca99742278: created successfully
Jul 19 19:52:08 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 007f01ea-a7dd-4c53-815d-85ca99742278: deleting
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352 1073741824" returned: 0 in 0.748s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 007f01ea-a7dd-4c53-815d-85ca99742278: deleting {{(pid=87353) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-f4bcccb9-8594-4690-bf39-432a8554b99f" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:08 devstack sudo[95098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352
Jul 19 19:52:08 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-f4bcccb9-8594-4690-bf39-432a8554b99f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-163996cf-f829-4e48-85b5-b666dd47c027" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-163996cf-f829-4e48-85b5-b666dd47c027" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Deleting offline snapshot 163996cf-f829-4e48-85b5-b666dd47c027 of volume f4bcccb9-8594-4690-bf39-432a8554b99f {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] snapshot_file for this snap is: volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[af89bdf8-b267-44b1-aecc-71bf962fbe6e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:08 devstack sudo[95100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027
Jul 19 19:52:08 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:08 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352" returned: 0 in 0.588s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3131efd3-b88a-45d8-84a2-62c97bfc993c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0081363e-85a4-401e-911b-05bf89615352', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7425e8f2-6192-4155-9019-8bd0994b2ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:08 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Volume volume-0081363e-85a4-401e-911b-05bf89615352 (0081363e-85a4-401e-911b-05bf89615352): created successfully
Jul 19 19:52:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7425e8f2-6192-4155-9019-8bd0994b2ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Flow 'volume_create_manager' (01a1360e-399e-4ad9-a592-8f05f513f097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:09 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e14420b8-db3a-44d5-b2f7-894f9edc6c86 tempest-VolumesTransfersTest-2096052586 None] Created volume successfully.
Jul 19 19:52:09 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027" returned: 0 in 0.725s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4bcccb9-8594-4690-bf39-432a8554b99f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:52:09 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e83688-b265-41f8-b566-4b995c01509c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:09 devstack sudo[95107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f
Jul 19 19:52:09 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Acquiring lock "cinder-0081363e-85a4-401e-911b-05bf89615352-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Lock "cinder-0081363e-85a4-401e-911b-05bf89615352-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Acquiring lock "cinder-quobyte-0081363e-85a4-401e-911b-05bf89615352" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Lock "cinder-quobyte-0081363e-85a4-401e-911b-05bf89615352" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:10 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f" returned: 0 in 0.758s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca1e23f-4978-42bc-b5cc-e8c158574184]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:10 devstack sudo[95112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027
Jul 19 19:52:10 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:10 devstack sudo[95113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352
Jul 19 19:52:10 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:10 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352" returned: 0 in 0.489s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:10 devstack sudo[95122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352
Jul 19 19:52:10 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:10 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027" returned: 0 in 0.661s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:10 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027
Jul 19 19:52:10 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:11 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0081363e-85a4-401e-911b-05bf89615352" returned: 0 in 0.534s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Lock "cinder-quobyte-0081363e-85a4-401e-911b-05bf89615352" released by "delete_volume" :: held 1.106s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:11 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f.163996cf-f829-4e48-85b5-b666dd47c027" returned: 0 in 0.444s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-163996cf-f829-4e48-85b5-b666dd47c027" released by "_delete_snapshot" :: held 2.792s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-f4bcccb9-8594-4690-bf39-432a8554b99f" released by "delete_snapshot" :: held 2.847s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Created reservations ['1c108055-f7dd-4c8d-8eb1-b06890ec55ce', '029bf3a9-98e2-4912-a76b-07c9582e4261', '3dc9bd75-97bc-45c3-bb61-b9f2bf06b65f', '3a08d37e-fe25-4464-80e3-3c318836b4c7'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:52:11 devstack cinder-volume[87353]: WARNING cinder.quota [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-777578319 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-777578319, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:52:11 devstack cinder-volume[87353]: WARNING cinder.quota [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-777578319 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-777578319, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['6171d56e-6e70-477b-857a-9d57fbb6274c', '9d2609e6-1976-47a8-aad9-aaf86278bd84', 'e132eb57-0f05-420a-bf1e-f3e6a39278a0', '24f13a8e-f11b-4ce8-9f34-44bf4d6f1fd0'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:11 devstack sudo[95128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:52:11 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f0f0549c-2cf4-4f6c-a2f7-f9e8afc02984 tempest-GroupSnapshotsTest-1278955057 None] group_snapshot 007f01ea-a7dd-4c53-815d-85ca99742278: deleted successfully
Jul 19 19:52:11 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.473s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:11 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:52:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Deleted volume successfully.
Jul 19 19:52:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-13b4373d-e1e6-4e7d-bc3b-18778541f0e6 tempest-VolumesTransfersTest-2134126381 None] Lock "cinder-0081363e-85a4-401e-911b-05bf89615352-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "cinder-quobyte-f4bcccb9-8594-4690-bf39-432a8554b99f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-f4bcccb9-8594-4690-bf39-432a8554b99f" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:12 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14d6c2-d54e-4598-955f-c7c1b9f6f9a6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:12 devstack sudo[95131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f
Jul 19 19:52:12 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:13 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f" returned: 0 in 0.655s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:13 devstack sudo[95137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f
Jul 19 19:52:13 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:13 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4bcccb9-8594-4690-bf39-432a8554b99f" returned: 0 in 0.321s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Lock "cinder-quobyte-f4bcccb9-8594-4690-bf39-432a8554b99f" released by "delete_volume" :: held 1.077s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['3cf1d2d1-4a16-44cb-a05b-5810a3eda376'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:52:13 devstack cinder-volume[87353]: WARNING cinder.quota [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-777578319 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-777578319, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Created reservations ['befd60e6-3ebf-4366-88d0-8ffaffd98b1f', '63a328d5-9ab0-4184-b0ea-216b16731da5', '5ca1aef1-14a1-4eb4-9668-7e3da498aa19', '934aa2ba-e150-4193-9007-fb3f4ccebe41'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:14 devstack sudo[95140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:52:14 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:14 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.331s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:14 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:52:14 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0e3b67e8-9bde-441d-a43f-c84619d8d864 tempest-GroupSnapshotsTest-1278955057 None] Delete group completed successfully.
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Flow 'volume_create_manager' (7b5c03f0-cddd-4b5e-afde-e153180a885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc06096d-49f1-42ca-8270-eff2250a134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc06096d-49f1-42ca-8270-eff2250a134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1650405444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2886b362-423d-4f9e-9b17-71b855950669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12f8eb4f1bd452db7c032d285481c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:23Z,use_quota=True,user_id='9e169d1f92864070b53748c8fb476835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ba9339-c4a6-44d5-ae6e-3905e875b3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ba9339-c4a6-44d5-ae6e-3905e875b3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99f478c-3a8a-4335-b1f5-181e49a4f42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99f478c-3a8a-4335-b1f5-181e49a4f42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2886b362-423d-4f9e-9b17-71b855950669', 'volume_name': 'volume-2886b362-423d-4f9e-9b17-71b855950669', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27b93c2-eaa1-42e4-bbb3-d8af2f60135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27b93c2-eaa1-42e4-bbb3-d8af2f60135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c3cb42-274f-47cb-ad13-f6d612524653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:23 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Volume 2886b362-423d-4f9e-9b17-71b855950669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2886b362-423d-4f9e-9b17-71b855950669', 'volume_size': 1}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1650405444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2886b362-423d-4f9e-9b17-71b855950669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12f8eb4f1bd452db7c032d285481c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:23Z,use_quota=True,user_id='9e169d1f92864070b53748c8fb476835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Creating volume 2886b362-423d-4f9e-9b17-71b855950669 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:52:23 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:23 devstack sudo[95204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669 1073741824
Jul 19 19:52:23 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:23 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669 1073741824" returned: 0 in 0.627s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:23 devstack sudo[95210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669
Jul 19 19:52:24 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:24 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669" returned: 0 in 0.277s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:52:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c3cb42-274f-47cb-ad13-f6d612524653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2886b362-423d-4f9e-9b17-71b855950669', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2decff50-6e8f-452f-9479-5881c389f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:24 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Volume volume-2886b362-423d-4f9e-9b17-71b855950669 (2886b362-423d-4f9e-9b17-71b855950669): created successfully
Jul 19 19:52:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2decff50-6e8f-452f-9479-5881c389f372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Flow 'volume_create_manager' (7b5c03f0-cddd-4b5e-afde-e153180a885f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:24 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1788cfb1-914e-4a2b-b62c-c80b669df87a tempest-VolumesTransfersV355Test-603613979 None] Created volume successfully.
Jul 19 19:52:26 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e0472669-01fe-4ca3-8e60-945ad047ae9a tempest-VolumesTransfersV355Test-901998173 None] Transfer volume completed successfully.
Jul 19 19:52:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Acquiring lock "cinder-2886b362-423d-4f9e-9b17-71b855950669-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Lock "cinder-2886b362-423d-4f9e-9b17-71b855950669-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Acquiring lock "cinder-quobyte-2886b362-423d-4f9e-9b17-71b855950669" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Lock "cinder-quobyte-2886b362-423d-4f9e-9b17-71b855950669" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:26 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35b6be-ad35-40c0-871a-da3c9e391e1a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:27 devstack sudo[95215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669
Jul 19 19:52:27 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:27 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669" returned: 0 in 0.403s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:27 devstack sudo[95220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669
Jul 19 19:52:27 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:27 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2886b362-423d-4f9e-9b17-71b855950669" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Lock "cinder-quobyte-2886b362-423d-4f9e-9b17-71b855950669" released by "delete_volume" :: held 0.743s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Created reservations ['698bbca0-10ce-45e6-974b-81b90030d8f0', '09cd4400-a204-420b-a78f-f19d1f0a9a57', 'ef1fd79b-b557-4a5e-88af-d1006fc1c9c0', '025ee0ca-5432-4b57-a272-d71f18857b01'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:27 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:52:27 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:28 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.337s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:52:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Deleted volume successfully.
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e425fd8d-6ad2-4df5-b30c-311b7d1ffc01 tempest-VolumesTransfersV355Test-1318651598 None] Lock "cinder-2886b362-423d-4f9e-9b17-71b855950669-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Flow 'volume_create_manager' (87694978-f092-4862-803b-bdec557fa026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f318512-ee5b-4b8a-924a-cce681f5b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f318512-ee5b-4b8a-924a-cce681f5b72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-604822635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25b1fea-1ca5-4fae-ac61-2ede0819ced7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979bcdb7bbf4325a72f90b235ce8ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:29Z,use_quota=True,user_id='d9615920171f40a1881ee1340e1248af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf3de4a-c047-4352-bf1b-e419e4785abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf3de4a-c047-4352-bf1b-e419e4785abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15429d62-1318-44ff-805a-76c6669fa988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15429d62-1318-44ff-805a-76c6669fa988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25b1fea-1ca5-4fae-ac61-2ede0819ced7', 'volume_name': 'volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4853b8f-6d59-4d49-bff3-716386391017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4853b8f-6d59-4d49-bff3-716386391017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d287058d-74bd-4c43-994d-61e6bb1ac845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:28 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Volume c25b1fea-1ca5-4fae-ac61-2ede0819ced7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7', 'volume_size': 1}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-604822635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25b1fea-1ca5-4fae-ac61-2ede0819ced7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979bcdb7bbf4325a72f90b235ce8ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:29Z,use_quota=True,user_id='d9615920171f40a1881ee1340e1248af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Creating volume c25b1fea-1ca5-4fae-ac61-2ede0819ced7 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:52:28 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:28 devstack sudo[95235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7 1073741824
Jul 19 19:52:28 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Flow 'volume_create_manager' (b9aba8fe-6212-434e-bcc9-81c38748894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0fcf02-7b6c-4a9c-a91c-92ec0c410b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0fcf02-7b6c-4a9c-a91c-92ec0c410b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-782533637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea706ec-3315-4223-861a-3dafe90ef782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12f8eb4f1bd452db7c032d285481c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:29Z,use_quota=True,user_id='9e169d1f92864070b53748c8fb476835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e905834-2d0e-4e9f-9519-5e2ea78de778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e905834-2d0e-4e9f-9519-5e2ea78de778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07d5c24-bcc3-40ff-bd2b-4d8fc642e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07d5c24-bcc3-40ff-bd2b-4d8fc642e506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea706ec-3315-4223-861a-3dafe90ef782', 'volume_name': 'volume-6ea706ec-3315-4223-861a-3dafe90ef782', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebabbc19-1578-4680-ba2d-1c97fdee1e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebabbc19-1578-4680-ba2d-1c97fdee1e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668991e1-1c17-4fc0-b000-719504651f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:29 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Volume 6ea706ec-3315-4223-861a-3dafe90ef782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea706ec-3315-4223-861a-3dafe90ef782', 'volume_size': 1}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:29 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7 1073741824" returned: 0 in 0.647s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:29 devstack sudo[95242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7
Jul 19 19:52:29 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:29 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7" returned: 0 in 0.302s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-782533637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea706ec-3315-4223-861a-3dafe90ef782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12f8eb4f1bd452db7c032d285481c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:29Z,use_quota=True,user_id='9e169d1f92864070b53748c8fb476835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Creating volume 6ea706ec-3315-4223-861a-3dafe90ef782 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:52:29 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d287058d-74bd-4c43-994d-61e6bb1ac845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (652a3892-d6a9-45a4-a2b7-54a8754a0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:29 devstack sudo[95245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782 1073741824
Jul 19 19:52:29 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:29 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Volume volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7 (c25b1fea-1ca5-4fae-ac61-2ede0819ced7): created successfully
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (652a3892-d6a9-45a4-a2b7-54a8754a0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Flow 'volume_create_manager' (87694978-f092-4862-803b-bdec557fa026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:29 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e00daf4b-7d56-4225-a3cb-73961ef88965 tempest-AttachVolumeTestJSON-1085432239 None] Created volume successfully.
Jul 19 19:52:30 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782 1073741824" returned: 0 in 0.683s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:30 devstack sudo[95251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782
Jul 19 19:52:30 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:31 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782" returned: 0 in 0.572s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:52:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668991e1-1c17-4fc0-b000-719504651f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea706ec-3315-4223-861a-3dafe90ef782', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6329f8-71b1-426f-a7f4-6c2d8595b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:31 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Volume volume-6ea706ec-3315-4223-861a-3dafe90ef782 (6ea706ec-3315-4223-861a-3dafe90ef782): created successfully
Jul 19 19:52:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6329f8-71b1-426f-a7f4-6c2d8595b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Flow 'volume_create_manager' (b9aba8fe-6212-434e-bcc9-81c38748894e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-05020e84-fc08-4947-8783-e53f99303f5c tempest-VolumesTransfersV355Test-603613979 None] Created volume successfully.
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-6fe56176-48d7-453a-a351-a0d4632d7720 req-3f75e14f-c1ed-44a4-b817-7f03bdcc5265 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-6fe56176-48d7-453a-a351-a0d4632d7720 req-3f75e14f-c1ed-44a4-b817-7f03bdcc5265 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-6fe56176-48d7-453a-a351-a0d4632d7720 req-3f75e14f-c1ed-44a4-b817-7f03bdcc5265 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-6fe56176-48d7-453a-a351-a0d4632d7720 req-3f75e14f-c1ed-44a4-b817-7f03bdcc5265 tempest-AttachVolumeTestJSON-1085432239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f70402a9-c76f-4b5b-bd52-a6f0ae56a95f', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Acquiring lock "cinder-6ea706ec-3315-4223-861a-3dafe90ef782-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-6fe56176-48d7-453a-a351-a0d4632d7720 req-3f75e14f-c1ed-44a4-b817-7f03bdcc5265 tempest-AttachVolumeTestJSON-1085432239 None] attachment_update completed successfully.
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Lock "cinder-6ea706ec-3315-4223-861a-3dafe90ef782-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Acquiring lock "cinder-quobyte-6ea706ec-3315-4223-861a-3dafe90ef782" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Lock "cinder-quobyte-6ea706ec-3315-4223-861a-3dafe90ef782" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2b4806-b69c-413c-aafb-e24f10dea5bb]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:32 devstack sudo[95326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:52:32 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:32 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782
Jul 19 19:52:32 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:33 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.509s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 8 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:52:33 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782" returned: 0 in 0.696s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:33 devstack sudo[95697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782
Jul 19 19:52:33 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:33 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6ea706ec-3315-4223-861a-3dafe90ef782" returned: 0 in 0.388s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Lock "cinder-quobyte-6ea706ec-3315-4223-861a-3dafe90ef782" released by "delete_volume" :: held 1.144s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:33 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Created reservations ['9b8c543d-d4d2-4861-8ed9-0d5feb5b1754', '6551d757-2554-4512-b395-3e1a9a200103', 'b16ea310-182a-4958-8b6e-26c3bbc86045', '462265f5-740a-4a27-96e9-3671644b84f8'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:34 devstack sudo[95713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:52:34 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:34 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.493s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:52:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Deleted volume successfully.
Jul 19 19:52:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b25db1d9-84d1-4265-ba5d-7f43a372ff38 tempest-VolumesTransfersV355Test-1318651598 None] Lock "cinder-6ea706ec-3315-4223-861a-3dafe90ef782-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Flow 'volume_create_manager' (761a13d4-d188-4dad-a012-7b38f129893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a5a51f-4fa0-43d1-80ef-f5d9acb3a68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a5a51f-4fa0-43d1-80ef-f5d9acb3a68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1185410851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008323e6-e07a-4e20-a754-7d5dfda7dc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c0dc45d4e84ae58f756a7c60678244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:41Z,use_quota=True,user_id='09ea460b2bbe4d15a9b6d302cae832de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4952920e-5e99-4b4f-ab4d-0da55b95b3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4952920e-5e99-4b4f-ab4d-0da55b95b3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26da988-3d3f-4df6-842a-7037f4fe213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26da988-3d3f-4df6-842a-7037f4fe213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '008323e6-e07a-4e20-a754-7d5dfda7dc54', 'volume_name': 'volume-008323e6-e07a-4e20-a754-7d5dfda7dc54', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d374cc-230c-449c-b9f3-a11275479378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d374cc-230c-449c-b9f3-a11275479378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd74bf49-af14-4bbe-891c-57ce49e8e11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:40 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Volume 008323e6-e07a-4e20-a754-7d5dfda7dc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-008323e6-e07a-4e20-a754-7d5dfda7dc54', 'volume_size': 1}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1185410851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008323e6-e07a-4e20-a754-7d5dfda7dc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c0dc45d4e84ae58f756a7c60678244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:41Z,use_quota=True,user_id='09ea460b2bbe4d15a9b6d302cae832de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Creating volume 008323e6-e07a-4e20-a754-7d5dfda7dc54 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:52:40 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:52:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:41 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54 1073741824
Jul 19 19:52:41 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:41 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54 1073741824" returned: 0 in 1.080s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:42 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54
Jul 19 19:52:42 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:42 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54" returned: 0 in 0.602s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd74bf49-af14-4bbe-891c-57ce49e8e11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-008323e6-e07a-4e20-a754-7d5dfda7dc54', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385e21ad-a919-49bb-8c27-c1a75a05d8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:42 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Volume volume-008323e6-e07a-4e20-a754-7d5dfda7dc54 (008323e6-e07a-4e20-a754-7d5dfda7dc54): created successfully
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385e21ad-a919-49bb-8c27-c1a75a05d8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Flow 'volume_create_manager' (761a13d4-d188-4dad-a012-7b38f129893d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c4fb3011-fdde-456d-8cfa-6b6eba516326 tempest-TestMinimumBasicScenario-253912615 None] Created volume successfully.
Jul 19 19:52:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-ef1b8db0-0dbb-4e52-94c5-8dd3c9538adf req-b086d40f-801c-46b8-87b2-e43efa290071 tempest-TestMinimumBasicScenario-253912615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-ef1b8db0-0dbb-4e52-94c5-8dd3c9538adf req-b086d40f-801c-46b8-87b2-e43efa290071 tempest-TestMinimumBasicScenario-253912615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-ef1b8db0-0dbb-4e52-94c5-8dd3c9538adf req-b086d40f-801c-46b8-87b2-e43efa290071 tempest-TestMinimumBasicScenario-253912615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-ef1b8db0-0dbb-4e52-94c5-8dd3c9538adf req-b086d40f-801c-46b8-87b2-e43efa290071 tempest-TestMinimumBasicScenario-253912615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-008323e6-e07a-4e20-a754-7d5dfda7dc54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b01c68e-e647-432d-bacf-7c39c0b26bb5', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:52:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-ef1b8db0-0dbb-4e52-94c5-8dd3c9538adf req-b086d40f-801c-46b8-87b2-e43efa290071 tempest-TestMinimumBasicScenario-253912615 None] attachment_update completed successfully.
Jul 19 19:52:53 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=97,cinder:INSERT=30,cinder:UPDATE=116,cinder:DELETE=5 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:52:53 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=115,cinder:SELECT=99,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:52:53 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:52:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Flow 'volume_create_manager' (c3f16009-229c-4d75-a9d2-d70d7303b002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe1e93b-d0f4-404f-b9dd-c0fc3dfe3508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe1e93b-d0f4-404f-b9dd-c0fc3dfe3508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-294481782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80eff145-b9fd-4bec-81ea-bc3d3d2f7c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34596b93cdb74fe3ac04dfbbf99296c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:54Z,use_quota=True,user_id='0f39a623fb6d4ef4aa602cd8daa0e00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9babc948-e587-43cc-9a48-4869258d032c),volume_type_id=9babc948-e587-43cc-9a48-4869258d032c)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54923554-c15e-411e-812c-8702384819d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54923554-c15e-411e-812c-8702384819d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d14bcd2-9a6d-4715-a2cf-f8134a1690e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d14bcd2-9a6d-4715-a2cf-f8134a1690e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80eff145-b9fd-4bec-81ea-bc3d3d2f7c25', 'volume_name': 'volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b6c777-904f-41e0-9762-0e8dc7dd1907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b6c777-904f-41e0-9762-0e8dc7dd1907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b0731e-5c00-4087-868c-3b7cdc08096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:54 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Volume 80eff145-b9fd-4bec-81ea-bc3d3d2f7c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25', 'volume_size': 1}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-294481782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80eff145-b9fd-4bec-81ea-bc3d3d2f7c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34596b93cdb74fe3ac04dfbbf99296c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:52:54Z,use_quota=True,user_id='0f39a623fb6d4ef4aa602cd8daa0e00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9babc948-e587-43cc-9a48-4869258d032c),volume_type_id=9babc948-e587-43cc-9a48-4869258d032c)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Creating volume 80eff145-b9fd-4bec-81ea-bc3d3d2f7c25 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:52:54 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:54 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25 1073741824
Jul 19 19:52:54 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:54 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25 1073741824" returned: 0 in 0.695s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:54 devstack sudo[96347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25
Jul 19 19:52:54 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:55 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25" returned: 0 in 0.326s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:52:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b0731e-5c00-4087-868c-3b7cdc08096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fc9a03-2b7b-4dfe-ad6c-fb6f7da25909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:55 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Volume volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25 (80eff145-b9fd-4bec-81ea-bc3d3d2f7c25): created successfully
Jul 19 19:52:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fc9a03-2b7b-4dfe-ad6c-fb6f7da25909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Flow 'volume_create_manager' (c3f16009-229c-4d75-a9d2-d70d7303b002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:55 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b9f3316b-48aa-4762-acaa-7a83d7dff56e tempest-VolumeTypesAccessTest-1107277086 None] Created volume successfully.
Jul 19 19:52:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Acquiring lock "cinder-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Lock "cinder-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Acquiring lock "cinder-quobyte-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:52:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Lock "cinder-quobyte-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:52:56 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3c080e-8ced-4d0f-88a5-c274caeb869b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:52:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:56 devstack sudo[96350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25
Jul 19 19:52:56 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:56 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25" returned: 0 in 0.408s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:56 devstack sudo[96355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25
Jul 19 19:52:56 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25" returned: 0 in 0.370s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:57 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Lock "cinder-quobyte-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25" released by "delete_volume" :: held 0.835s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:57 devstack cinder-volume[87353]: WARNING cinder.quota [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1944880892 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1944880892, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:52:57 devstack cinder-volume[87353]: WARNING cinder.quota [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1944880892 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1944880892, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Created reservations ['3754d3d2-17af-469a-adee-c844d4757c7e', 'a810903e-6c7b-4f8f-8424-6a4f0205c997', 'b3bf73f0-fad6-4164-ad0b-11045fb2b070', '0d5fd96a-0af9-408a-bd35-9aaa879504af'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:57 devstack sudo[96359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:52:57 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:52:57 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.441s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:52:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Deleted volume successfully.
Jul 19 19:52:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aee2f405-7582-4e10-a2ca-70a35069b683 tempest-VolumeTypesAccessTest-1107277086 None] Lock "cinder-80eff145-b9fd-4bec-81ea-bc3d3d2f7c25-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Flow 'volume_create_manager' (aac5761d-ec1e-4c63-ba14-6d4dc77653e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5249218-a887-4185-b0ca-cf87cd08bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5249218-a887-4185-b0ca-cf87cd08bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-476885769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924591fb-bc45-46d4-b17b-afdbbbae333a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a57416a27d4d7383cb94ca2ce719cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:53:00Z,use_quota=True,user_id='00fdef2cdd5a40bca119b2f6bb503f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ba9035-d215-4841-a1ad-48737b54e1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ba9035-d215-4841-a1ad-48737b54e1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77744746-59f6-44d0-9ef2-db789cb569fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77744746-59f6-44d0-9ef2-db789cb569fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924591fb-bc45-46d4-b17b-afdbbbae333a', 'volume_name': 'volume-924591fb-bc45-46d4-b17b-afdbbbae333a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4c8b4a-c100-46be-992e-58f7f0a5e7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4c8b4a-c100-46be-992e-58f7f0a5e7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae26c3cc-c770-4be1-b399-976bb2a93aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:52:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Volume 924591fb-bc45-46d4-b17b-afdbbbae333a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924591fb-bc45-46d4-b17b-afdbbbae333a', 'volume_size': 1}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-476885769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924591fb-bc45-46d4-b17b-afdbbbae333a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a57416a27d4d7383cb94ca2ce719cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:53:00Z,use_quota=True,user_id='00fdef2cdd5a40bca119b2f6bb503f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Creating volume 924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:52:59 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:52:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:52:59 devstack sudo[96391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a 1073741824
Jul 19 19:52:59 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:00 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a 1073741824" returned: 0 in 0.792s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:00 devstack sudo[96397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:53:00 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:01 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:53:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:53:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae26c3cc-c770-4be1-b399-976bb2a93aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924591fb-bc45-46d4-b17b-afdbbbae333a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:53:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577b47fd-248b-4605-adbe-281453eaabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:53:01 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Volume volume-924591fb-bc45-46d4-b17b-afdbbbae333a (924591fb-bc45-46d4-b17b-afdbbbae333a): created successfully
Jul 19 19:53:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577b47fd-248b-4605-adbe-281453eaabd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:53:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Flow 'volume_create_manager' (aac5761d-ec1e-4c63-ba14-6d4dc77653e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:53:01 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-32ad953c-b100-4cdb-b60e-660f3b9375f0 tempest-VolumesActionsTest-1664853888 None] Created volume successfully.
Jul 19 19:53:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cdda892-5292-43f7-bb60-97a3fca2cf16 tempest-VolumesActionsTest-1664853888 None] Acquiring lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a" by "attach_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:53:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cdda892-5292-43f7-bb60-97a3fca2cf16 tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a" acquired by "attach_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:53:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9cdda892-5292-43f7-bb60-97a3fca2cf16 tempest-VolumesActionsTest-1664853888 None] Attaching volume 924591fb-bc45-46d4-b17b-afdbbbae333a to instance d5fe755b-250c-4aca-ae8a-f697a200c482 at mountpoint /dev/vdb on host None.
Jul 19 19:53:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9cdda892-5292-43f7-bb60-97a3fca2cf16 tempest-VolumesActionsTest-1664853888 None] Attach volume completed successfully.
Jul 19 19:53:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cdda892-5292-43f7-bb60-97a3fca2cf16 tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a" released by "attach_volume" :: held 0.124s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:53:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad0fe182-fc64-4361-aecb-5570c98ab074 tempest-VolumesActionsTest-1664853888 None] Acquiring lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-detach_volume" by "detach_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:53:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad0fe182-fc64-4361-aecb-5570c98ab074 tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:53:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ad0fe182-fc64-4361-aecb-5570c98ab074 tempest-VolumesActionsTest-1664853888 None] Detaching volume 924591fb-bc45-46d4-b17b-afdbbbae333a from instance d5fe755b-250c-4aca-ae8a-f697a200c482.
Jul 19 19:53:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ad0fe182-fc64-4361-aecb-5570c98ab074 tempest-VolumesActionsTest-1664853888 None] Detach volume completed successfully.
Jul 19 19:53:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad0fe182-fc64-4361-aecb-5570c98ab074 tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:53:21 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=19,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:53:21 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:53:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-b1db4f09-6d93-46d6-9e82-86eddc1e0582 req-b46eca46-0481-44b8-826d-3aaa16dc242c tempest-AttachVolumeTestJSON-1085432239 None] Terminate volume connection completed successfully.
Jul 19 19:53:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-b1db4f09-6d93-46d6-9e82-86eddc1e0582 req-b46eca46-0481-44b8-826d-3aaa16dc242c tempest-AttachVolumeTestJSON-1085432239 None] Deleting attachment f70402a9-c76f-4b5b-bd52-a6f0ae56a95f. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:53:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7497f413-cee5-4774-9b02-bbca73b4ae6f tempest-VolumesActionsTest-1664853888 None] Acquiring lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a" by "attach_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:53:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7497f413-cee5-4774-9b02-bbca73b4ae6f tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a" acquired by "attach_volume" :: waited 0.071s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:53:29 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7497f413-cee5-4774-9b02-bbca73b4ae6f tempest-VolumesActionsTest-1664853888 None] Attaching volume 924591fb-bc45-46d4-b17b-afdbbbae333a to instance ebf2a27b-1360-4c52-83af-b427347bd1fd at mountpoint /dev/vdb on host None.
Jul 19 19:53:29 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7497f413-cee5-4774-9b02-bbca73b4ae6f tempest-VolumesActionsTest-1664853888 None] Attach volume completed successfully.
Jul 19 19:53:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7497f413-cee5-4774-9b02-bbca73b4ae6f tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a" released by "attach_volume" :: held 0.277s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:53:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3e7a218-3fc8-4d0c-810e-9fd3cf55b9e5 tempest-VolumesActionsTest-1664853888 None] Acquiring lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-detach_volume" by "detach_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:53:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3e7a218-3fc8-4d0c-810e-9fd3cf55b9e5 tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:53:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f3e7a218-3fc8-4d0c-810e-9fd3cf55b9e5 tempest-VolumesActionsTest-1664853888 None] Detaching volume 924591fb-bc45-46d4-b17b-afdbbbae333a from instance ebf2a27b-1360-4c52-83af-b427347bd1fd.
Jul 19 19:53:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f3e7a218-3fc8-4d0c-810e-9fd3cf55b9e5 tempest-VolumesActionsTest-1664853888 None] Detach volume completed successfully.
Jul 19 19:53:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3e7a218-3fc8-4d0c-810e-9fd3cf55b9e5 tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:53:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:53:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:53:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:53:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:53:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:53:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:53:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:32 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:53:32 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:33 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.528s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:53:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:53:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 8 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:53:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:53:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:53:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:53:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[29356074-f156-4d82-9eba-1ab4df5536c2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:53:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:37 devstack sudo[96830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:53:37 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:37 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.556s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:37 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[11726232-3376-433e-8120-e4b0a606b8ab]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:53:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:37 devstack sudo[96836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:53:37 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:38 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.511s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.0a3bc660-e2dd-4402-b738-831606af8c729aam4p7s.img {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:38 devstack sudo[96842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.0a3bc660-e2dd-4402-b738-831606af8c729aam4p7s.img
Jul 19 19:53:38 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:40 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:53:45 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.0a3bc660-e2dd-4402-b738-831606af8c729aam4p7s.img" returned: 0 in 7.452s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[13945475-c94d-4c8c-bbaf-ec742fe1604d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:53:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:45 devstack sudo[96885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:53:45 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:46 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.683s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:46 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.0a3bc660-e2dd-4402-b738-831606af8c729aam4p7s.img {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:53:46 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Converted 1024.00 MB image at 137.37 MB/s
Jul 19 19:53:46 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] 0a3bc660-e2dd-4402-b738-831606af8c72 was raw, no need to convert to raw {{(pid=87353) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 19 19:53:48 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-f8c1d1f1-c34e-46f2-8208-dfc8b592d3ba req-274a0aa8-944d-4e7e-8998-06602d22801d tempest-TestMinimumBasicScenario-253912615 None] Terminate volume connection completed successfully.
Jul 19 19:53:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-f8c1d1f1-c34e-46f2-8208-dfc8b592d3ba req-274a0aa8-944d-4e7e-8998-06602d22801d tempest-TestMinimumBasicScenario-253912615 None] Deleting attachment 7b01c68e-e647-432d-bacf-7c39c0b26bb5. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:53:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Acquiring lock "cinder-008323e6-e07a-4e20-a754-7d5dfda7dc54-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:53:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Lock "cinder-008323e6-e07a-4e20-a754-7d5dfda7dc54-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:53:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Acquiring lock "cinder-quobyte-008323e6-e07a-4e20-a754-7d5dfda7dc54" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:53:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Lock "cinder-quobyte-008323e6-e07a-4e20-a754-7d5dfda7dc54" acquired by "delete_volume" :: waited 0.048s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:53:49 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f21083-dc5e-438c-b7cf-da8b7232eee2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:53:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:49 devstack sudo[96979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54
Jul 19 19:53:49 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:50 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54" returned: 0 in 0.715s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:50 devstack sudo[96991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54
Jul 19 19:53:50 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:50 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-008323e6-e07a-4e20-a754-7d5dfda7dc54" returned: 0 in 0.599s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Lock "cinder-quobyte-008323e6-e07a-4e20-a754-7d5dfda7dc54" released by "delete_volume" :: held 1.415s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Created reservations ['85ccf25b-5aea-4682-9f48-37b4d455c016', '363fa2c8-8b07-44dc-bca7-58946fbbebf2', 'c8c626cc-974f-4427-a8e3-61851a61055b', 'cd81cda1-3392-4284-aff8-d90a699fb18e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:53:51 devstack sudo[96995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:53:51 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:53:51 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.328s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:53:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Deleted volume successfully.
Jul 19 19:53:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-481218a1-8730-4d17-a904-7eab978179ba tempest-TestMinimumBasicScenario-253912615 None] Lock "cinder-008323e6-e07a-4e20-a754-7d5dfda7dc54-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (55daee04-6529-4a6e-ac57-ee76d8d9dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efabbe1-05c0-4557-8d4f-010cb91bb5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efabbe1-05c0-4557-8d4f-010cb91bb5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-647723613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6685e546-326a-49aa-91c1-745f046c5968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:53:54Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef7fcaf-5e48-4248-b467-1ce691d30f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef7fcaf-5e48-4248-b467-1ce691d30f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e2f1d3-6f28-4c07-bf6f-f82dee41d047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e2f1d3-6f28-4c07-bf6f-f82dee41d047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6685e546-326a-49aa-91c1-745f046c5968', 'volume_name': 'volume-6685e546-326a-49aa-91c1-745f046c5968', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69378146-a214-48e8-82d7-0bb7fa01ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69378146-a214-48e8-82d7-0bb7fa01ff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4c5a97-bafd-492e-952b-7786c668487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:53:53 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Volume 6685e546-326a-49aa-91c1-745f046c5968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6685e546-326a-49aa-91c1-745f046c5968', 'volume_size': 1}
Jul 19 19:53:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:03 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:54:03 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.463s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Uploaded volume to glance image-id: 0a3bc660-e2dd-4402-b738-831606af8c72. {{(pid=87353) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.440s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-647723613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6685e546-326a-49aa-91c1-745f046c5968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:53:54Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Creating volume 6685e546-326a-49aa-91c1-745f046c5968 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:19 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7d51b093-c70f-49f3-b8d0-a3da60b3b39a tempest-VolumesActionsTest-1664853888 None] Copy volume to image completed successfully.
Jul 19 19:54:19 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968 1073741824
Jul 19 19:54:19 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:20 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968 1073741824" returned: 0 in 0.572s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:20 devstack sudo[97220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968
Jul 19 19:54:20 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:20 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4c5a97-bafd-492e-952b-7786c668487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6685e546-326a-49aa-91c1-745f046c5968', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7dc0a4-283f-421e-8c38-b52ff1bdfda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:20 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Volume volume-6685e546-326a-49aa-91c1-745f046c5968 (6685e546-326a-49aa-91c1-745f046c5968): created successfully
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7dc0a4-283f-421e-8c38-b52ff1bdfda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (55daee04-6529-4a6e-ac57-ee76d8d9dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:20 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ae53e602-6e58-4935-80e3-2a7529747ed9 tempest-VolumesActionsTest-1908232112 None] Created volume successfully.
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Flow 'volume_create_manager' (e5329569-3a11-4dad-92f6-527d83a6827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c50daa6-4222-4102-8da9-15ff2481e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c50daa6-4222-4102-8da9-15ff2481e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a839b787-8189-40ae-ad51-6645056a125a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2734cff41b4e413c93638182d7f9c62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:21Z,use_quota=True,user_id='af5332b903794d9cb237a6ab4fb1ba71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81c36e9d-21df-45d7-a229-0220b08bf05a),volume_type_id=81c36e9d-21df-45d7-a229-0220b08bf05a)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8862915-e2e4-420e-98f6-4f147369f346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8862915-e2e4-420e-98f6-4f147369f346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2d1d8a-a687-4ea5-a422-8be874acea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:20 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2d1d8a-a687-4ea5-a422-8be874acea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a839b787-8189-40ae-ad51-6645056a125a', 'volume_name': 'volume-a839b787-8189-40ae-ad51-6645056a125a', 'volume_size': 1, 'image_id': 'e314461e-b8cc-46c9-a3fb-ab731452fb73', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e314461e-b8cc-46c9-a3fb-ab731452fb73', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5ff760ead0f8edf0eda6c9d0958f7e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2734cff41b4e413c93638182d7f9c62f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46c58fc8f6288d8751043a058d56339f407c03c415940dcfa58d4ec07420ca1991baa39b49809d69245446a6509862d2bcd59ff5b02317dcfd8261e504f82d3a', 'id': 'e314461e-b8cc-46c9-a3fb-ab731452fb73', 'created_at': datetime.datetime(2026, 7, 19, 17, 54, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e314461e-b8cc-46c9-a3fb-ab731452fb73/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb2b10>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e860f858-0f50-430c-a4fc-9505d841d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e860f858-0f50-430c-a4fc-9505d841d852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99925ac0-47a2-43e4-aa7f-f972cc5d7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:21 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Volume a839b787-8189-40ae-ad51-6645056a125a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a839b787-8189-40ae-ad51-6645056a125a', 'volume_size': 1, 'image_id': 'e314461e-b8cc-46c9-a3fb-ab731452fb73', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e314461e-b8cc-46c9-a3fb-ab731452fb73', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5ff760ead0f8edf0eda6c9d0958f7e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2734cff41b4e413c93638182d7f9c62f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46c58fc8f6288d8751043a058d56339f407c03c415940dcfa58d4ec07420ca1991baa39b49809d69245446a6509862d2bcd59ff5b02317dcfd8261e504f82d3a', 'id': 'e314461e-b8cc-46c9-a3fb-ab731452fb73', 'created_at': datetime.datetime(2026, 7, 19, 17, 54, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e314461e-b8cc-46c9-a3fb-ab731452fb73/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb2b10>}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Trying to clone a839b787-8189-40ae-ad51-6645056a125a from image e314461e-b8cc-46c9-a3fb-ab731452fb73 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e314461e-b8cc-46c9-a3fb-ab731452fb73', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 19:54:21 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Image download 0.00 MB at 0.00 MB/s
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[351c4483-4cbc-4685-9c4d-be1d3b260ba1]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[07671504-eab2-4e8a-8b30-be7608bb41c5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5f90365d-c7ad-492d-b437-0de9db854c60 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "cinder-6685e546-326a-49aa-91c1-745f046c5968" by "attach_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5f90365d-c7ad-492d-b437-0de9db854c60 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-6685e546-326a-49aa-91c1-745f046c5968" acquired by "attach_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:21 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5f90365d-c7ad-492d-b437-0de9db854c60 tempest-VolumesActionsTest-1908232112 None] Attaching volume 6685e546-326a-49aa-91c1-745f046c5968 to instance 1427b6f4-7f4e-4c6f-9e0c-bc26fc2eac3a at mountpoint /dev/vdb on host None.
Jul 19 19:54:21 devstack sudo[97223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD
Jul 19 19:54:21 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:21 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5f90365d-c7ad-492d-b437-0de9db854c60 tempest-VolumesActionsTest-1908232112 None] Attach volume completed successfully.
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5f90365d-c7ad-492d-b437-0de9db854c60 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-6685e546-326a-49aa-91c1-745f046c5968" released by "attach_volume" :: held 0.102s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:21 devstack sudo[97224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:54:21 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:21 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:22 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.514s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:22 devstack sudo[97229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD
Jul 19 19:54:22 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[01687421-70b6-429e-ac4b-3e6da2bc1b52]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:22 devstack sudo[97235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:54:22 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:22 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Temporary image e314461e-b8cc-46c9-a3fb-ab731452fb73 is fetched for user af5332b903794d9cb237a6ab4fb1ba71. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb64ecc9-4828-4bc0-b208-b7dbed6e4528]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ef991497-3baa-46a5-9157-7ae6c6ae2b0b tempest-VolumesActionsTest-1239747187 None] Terminate volume connection completed successfully.
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ef991497-3baa-46a5-9157-7ae6c6ae2b0b tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-detach_volume" by "detach_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ef991497-3baa-46a5-9157-7ae6c6ae2b0b tempest-VolumesActionsTest-1239747187 None] Lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ef991497-3baa-46a5-9157-7ae6c6ae2b0b tempest-VolumesActionsTest-1239747187 None] Detaching volume 6685e546-326a-49aa-91c1-745f046c5968 from instance 1427b6f4-7f4e-4c6f-9e0c-bc26fc2eac3a.
Jul 19 19:54:22 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:22 devstack sudo[97240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD
Jul 19 19:54:22 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.508s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:22 devstack sudo[97245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img
Jul 19 19:54:22 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ef991497-3baa-46a5-9157-7ae6c6ae2b0b tempest-VolumesActionsTest-1239747187 None] Detach volume completed successfully.
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ef991497-3baa-46a5-9157-7ae6c6ae2b0b tempest-VolumesActionsTest-1239747187 None] Lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:22 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-36049ffd-64b4-4a00-8d48-09498f0ccf0f tempest-VolumesActionsTest-1908232112 None] Acquiring lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-detach_volume" by "detach_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-36049ffd-64b4-4a00-8d48-09498f0ccf0f tempest-VolumesActionsTest-1908232112 None] Lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-36049ffd-64b4-4a00-8d48-09498f0ccf0f tempest-VolumesActionsTest-1908232112 None] Volume detach called, but volume not attached.
Jul 19 19:54:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-36049ffd-64b4-4a00-8d48-09498f0ccf0f tempest-VolumesActionsTest-1908232112 None] Lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:22 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD
Jul 19 19:54:22 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "cinder-quobyte-6685e546-326a-49aa-91c1-745f046c5968" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-quobyte-6685e546-326a-49aa-91c1-745f046c5968" acquired by "delete_volume" :: waited 0.060s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:23 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD" returned: 1 in 0.940s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[542005bc-02d7-4c40-94d5-f20453b1bc17]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:24 devstack sudo[97266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968
Jul 19 19:54:24 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:24 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968" returned: 0 in 1.209s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:24 devstack sudo[97271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968
Jul 19 19:54:24 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:25 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6685e546-326a-49aa-91c1-745f046c5968" returned: 0 in 0.664s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-quobyte-6685e546-326a-49aa-91c1-745f046c5968" released by "delete_volume" :: held 2.008s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:25 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Created reservations ['feda958b-90b9-433c-927e-06729849dd9b', '3a8145ff-e2cf-4e80-bffb-47b47452bbc5', '0a706e60-01b0-46ca-8a25-4cf594655f10', '315a08de-c601-47c7-95df-325944d6151f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:26 devstack sudo[97274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:54:26 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:26 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.701s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:54:26 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Deleted volume successfully.
Jul 19 19:54:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fba83ab4-ecab-4d07-ab80-c4e6d08974f9 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-6685e546-326a-49aa-91c1-745f046c5968-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:29 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img" returned: 0 in 6.721s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b85c0-33a0-43ed-94c4-c4a454cd97c7]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:29 devstack sudo[97338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:54:29 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:29 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.539s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:29 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:54:29 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Converted 1024.00 MB image at 152.34 MB/s
Jul 19 19:54:29 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] 270968e0-2e4d-4f9a-9d86-64974ae3faf4 was raw, converting to qcow2 {{(pid=87353) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 19 19:54:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[817ceb72-aea3-41d4-881e-1833d507426e]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:30 devstack sudo[97345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img
Jul 19 19:54:30 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:30 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img" returned: 0 in 0.392s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:30 devstack sudo[97349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img
Jul 19 19:54:30 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:30 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img" returned: 1 in 0.340s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img /opt/stack/data/cinder/conversion/vol_upload_sux5bb7q {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:30 devstack sudo[97354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img /opt/stack/data/cinder/conversion/vol_upload_sux5bb7q
Jul 19 19:54:30 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:30 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img /opt/stack/data/cinder/conversion/vol_upload_sux5bb7q" returned: 0 in 0.255s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Image conversion details: src /opt/stack/data/cinder/conversion/924591fb-bc45-46d4-b17b-afdbbbae333a.temp_image.270968e0-2e4d-4f9a-9d86-64974ae3faf4dw60j8ki.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_sux5bb7q {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:54:30 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[137e95ad-7e60-49d6-907b-6c7d1c1dc013]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sux5bb7q {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:30 devstack sudo[97359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sux5bb7q
Jul 19 19:54:30 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:31 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sux5bb7q" returned: 0 in 0.350s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (b3af6585-5451-4038-859a-0f39d645f3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892510ce-6288-49ed-97ea-80cb98a8acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892510ce-6288-49ed-97ea-80cb98a8acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107938464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b2d8a5-5c21-4210-9f63-fdc3d8225e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:31Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39ae099-ee18-42d1-9436-5f16d4f794ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39ae099-ee18-42d1-9436-5f16d4f794ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5714fc9-aa58-4718-89a6-19eafcfd763d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5714fc9-aa58-4718-89a6-19eafcfd763d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b2d8a5-5c21-4210-9f63-fdc3d8225e92', 'volume_name': 'volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a01689-4c7e-461c-9894-8061ff061ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a01689-4c7e-461c-9894-8061ff061ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c477dd9c-0f79-4d43-bb25-f2336210131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:31 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Volume 34b2d8a5-5c21-4210-9f63-fdc3d8225e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92', 'volume_size': 1}
Jul 19 19:54:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.016s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Uploaded volume to glance image-id: 270968e0-2e4d-4f9a-9d86-64974ae3faf4. {{(pid=87353) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.780s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a839b787-8189-40ae-ad51-6645056a125a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2734cff41b4e413c93638182d7f9c62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:21Z,use_quota=True,user_id='af5332b903794d9cb237a6ab4fb1ba71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81c36e9d-21df-45d7-a229-0220b08bf05a),volume_type_id=81c36e9d-21df-45d7-a229-0220b08bf05a)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Creating volume a839b787-8189-40ae-ad51-6645056a125a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:32 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:32 devstack sudo[97370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a 1073741824
Jul 19 19:54:32 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-606a7afa-807a-48db-9faf-b5e947629473 tempest-VolumesActionsTest-1664853888 None] Copy volume to image completed successfully.
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:32 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:54:32 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:32 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a 1073741824" returned: 0 in 0.421s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:32 devstack sudo[97378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a
Jul 19 19:54:32 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:33 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:54:33 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.586s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107938464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b2d8a5-5c21-4210-9f63-fdc3d8225e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:31Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Creating volume 34b2d8a5-5c21-4210-9f63-fdc3d8225e92 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:33 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:33 devstack sudo[97382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92 1073741824
Jul 19 19:54:33 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Attempting download of e314461e-b8cc-46c9-a3fb-ab731452fb73 ((None, [{'url': 'file:///opt/stack/data/glance/images/e314461e-b8cc-46c9-a3fb-ab731452fb73', 'metadata': {}}])) to volume a839b787-8189-40ae-ad51-6645056a125a. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[233ba9e5-ee3c-4f19-a099-80cd56b0cd57]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e314461e-b8cc-46c9-a3fb-ab731452fb73_6n5g4u6m {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:33 devstack sudo[97384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e314461e-b8cc-46c9-a3fb-ab731452fb73_6n5g4u6m
Jul 19 19:54:33 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:33 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92 1073741824" returned: 0 in 0.485s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:33 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e314461e-b8cc-46c9-a3fb-ab731452fb73_6n5g4u6m" returned: 0 in 0.391s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e314461e-b8cc-46c9-a3fb-ab731452fb73_6n5g4u6m {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:33 devstack sudo[97394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92
Jul 19 19:54:33 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:33 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e314461e-b8cc-46c9-a3fb-ab731452fb73_6n5g4u6m
Jul 19 19:54:33 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:34 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c477dd9c-0f79-4d43-bb25-f2336210131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dbcf30-5bea-4139-93c8-3e5d35958577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Volume volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92 (34b2d8a5-5c21-4210-9f63-fdc3d8225e92): created successfully
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dbcf30-5bea-4139-93c8-3e5d35958577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (b3af6585-5451-4038-859a-0f39d645f3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Acquiring lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-46752c14-c968-4dab-b0af-38858008373f tempest-VolumesActionsTest-1908232112 None] Created volume successfully.
Jul 19 19:54:34 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e314461e-b8cc-46c9-a3fb-ab731452fb73_6n5g4u6m" returned: 1 in 0.407s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e314461e-b8cc-46c9-a3fb-ab731452fb73_6n5g4u6m' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b4fc7-2ac1-4087-bb8c-f17dca4d1f30]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Acquiring lock "cinder-quobyte-924591fb-bc45-46d4-b17b-afdbbbae333a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Lock "cinder-quobyte-924591fb-bc45-46d4-b17b-afdbbbae333a" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a610535f-5633-4259-bf2c-17fbf117fdcf]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:34 devstack sudo[97400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD
Jul 19 19:54:34 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:34 devstack sudo[97401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:54:34 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:34 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:34 devstack sudo[97406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD
Jul 19 19:54:34 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:34 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.445s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:34 devstack sudo[97411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a
Jul 19 19:54:34 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-34b2d8a5-5c21-4210-9f63-fdc3d8225e92-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Lock "cinder-34b2d8a5-5c21-4210-9f63-fdc3d8225e92-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:34 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] e314461e-b8cc-46c9-a3fb-ab731452fb73 was raw, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 19:54:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:35 devstack sudo[97416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a
Jul 19 19:54:35 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-quobyte-34b2d8a5-5c21-4210-9f63-fdc3d8225e92" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Lock "cinder-quobyte-34b2d8a5-5c21-4210-9f63-fdc3d8225e92" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[296a603e-e875-481f-9f7d-6897e9304fc0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:35 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-924591fb-bc45-46d4-b17b-afdbbbae333a" returned: 0 in 0.394s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Lock "cinder-quobyte-924591fb-bc45-46d4-b17b-afdbbbae333a" released by "delete_volume" :: held 0.891s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Created reservations ['73dc1180-0226-4b0c-bf11-414adab0054b', '791b5db0-70f5-403c-aee9-af0bd560284e', '5f95047d-881f-429c-bf41-badd68debe1b', 'dc5b5c9b-fbaf-4ff3-b2f0-ca4c928bc08d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:54:35 devstack sudo[97419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92
Jul 19 19:54:35 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:35 devstack sudo[97424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:54:35 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:35 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a" returned: 0 in 0.567s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e314461e-b8cc-46c9-a3fb-ab731452fb73_odvhfq8bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:54:35 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Converted 0.00 MB image at 0.00 MB/s
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:35 devstack sudo[97429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a 1G
Jul 19 19:54:35 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:35 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.303s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:54:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Deleted volume successfully.
Jul 19 19:54:35 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92" returned: 0 in 0.536s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a89911a8-f023-4bb2-b169-547c48c0b7ca tempest-VolumesActionsTest-1664853888 None] Lock "cinder-924591fb-bc45-46d4-b17b-afdbbbae333a-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:35 devstack sudo[97434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92
Jul 19 19:54:35 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:35 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a 1G" returned: 0 in 0.354s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Downloaded image e314461e-b8cc-46c9-a3fb-ab731452fb73 ((None, [{'url': 'file:///opt/stack/data/glance/images/e314461e-b8cc-46c9-a3fb-ab731452fb73', 'metadata': {}}])) to volume a839b787-8189-40ae-ad51-6645056a125a successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Temporary image e314461e-b8cc-46c9-a3fb-ab731452fb73 for user af5332b903794d9cb237a6ab4fb1ba71 is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Marking volume a839b787-8189-40ae-ad51-6645056a125a as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Copying metadata from image e314461e-b8cc-46c9-a3fb-ab731452fb73 to a839b787-8189-40ae-ad51-6645056a125a. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Creating volume glance metadata for volume a839b787-8189-40ae-ad51-6645056a125a backed by image e314461e-b8cc-46c9-a3fb-ab731452fb73 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e314461e-b8cc-46c9-a3fb-ab731452fb73', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c5ff760ead0f8edf0eda6c9d0958f7e7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 19:54:35 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-34b2d8a5-5c21-4210-9f63-fdc3d8225e92" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Lock "cinder-quobyte-34b2d8a5-5c21-4210-9f63-fdc3d8225e92" released by "delete_volume" :: held 0.880s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99925ac0-47a2-43e4-aa7f-f972cc5d7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a839b787-8189-40ae-ad51-6645056a125a', 'volume_size': 1, 'image_id': 'e314461e-b8cc-46c9-a3fb-ab731452fb73', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e314461e-b8cc-46c9-a3fb-ab731452fb73', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5ff760ead0f8edf0eda6c9d0958f7e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2734cff41b4e413c93638182d7f9c62f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46c58fc8f6288d8751043a058d56339f407c03c415940dcfa58d4ec07420ca1991baa39b49809d69245446a6509862d2bcd59ff5b02317dcfd8261e504f82d3a', 'id': 'e314461e-b8cc-46c9-a3fb-ab731452fb73', 'created_at': datetime.datetime(2026, 7, 19, 17, 54, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 54, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e314461e-b8cc-46c9-a3fb-ab731452fb73/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb2b10>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c327d4c6-5a84-44e1-887e-85b4c5985783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Created reservations ['ea30352f-2e96-46d9-a1cf-7009f97a7a63', 'a6b6725d-881f-49b3-bbb2-8a7242308f17', '52349519-1028-4aeb-ad67-7a38a7a409f0', 'ee68f1c9-3a5a-4119-97eb-1477f0ff9ba3'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:54:36 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Volume volume-a839b787-8189-40ae-ad51-6645056a125a (a839b787-8189-40ae-ad51-6645056a125a): created successfully
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c327d4c6-5a84-44e1-887e-85b4c5985783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Flow 'volume_create_manager' (e5329569-3a11-4dad-92f6-527d83a6827a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-30b67c04-b9c3-4e1d-81ab-ecb378e45529 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Created volume successfully.
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:36 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:54:36 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:36 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:54:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Deleted volume successfully.
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ddd744f2-a781-4df7-ab91-f4f3c3b377c5 tempest-VolumesActionsTest-1239747187 None] Lock "cinder-34b2d8a5-5c21-4210-9f63-fdc3d8225e92-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Acquiring lock "cinder-a839b787-8189-40ae-ad51-6645056a125a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "cinder-a839b787-8189-40ae-ad51-6645056a125a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Acquiring lock "cinder-quobyte-a839b787-8189-40ae-ad51-6645056a125a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "cinder-quobyte-a839b787-8189-40ae-ad51-6645056a125a" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7c5682-9768-479d-aaf5-7b5ab0a8e606]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:36 devstack sudo[97443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a
Jul 19 19:54:36 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:37 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a" returned: 0 in 0.451s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:37 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a
Jul 19 19:54:37 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:37 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a839b787-8189-40ae-ad51-6645056a125a" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "cinder-quobyte-a839b787-8189-40ae-ad51-6645056a125a" released by "delete_volume" :: held 0.765s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:37 devstack cinder-volume[87353]: WARNING cinder.quota [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:54:37 devstack cinder-volume[87353]: WARNING cinder.quota [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Created reservations ['665345d1-7169-42c2-a709-1e2db6f1db09', 'a5b60008-85e4-4c18-841d-4e08655d09fe', '82e3bbc2-7298-4681-8986-017cfd494cee', '9f16fd52-2c9c-4e06-b92a-5c12fba732d4'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:37 devstack sudo[97453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:54:37 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (3669151a-f0a0-4372-812d-1507a4256a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603a99be-24e5-4b3d-ba92-4d9f72244f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603a99be-24e5-4b3d-ba92-4d9f72244f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1510498432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b276343b-477c-410b-a7ee-53421604a1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:38Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8129137-0fa2-413b-81ba-55c79a336e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8129137-0fa2-413b-81ba-55c79a336e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e814c783-272c-432b-8c7a-6f8d2631c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e814c783-272c-432b-8c7a-6f8d2631c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b276343b-477c-410b-a7ee-53421604a1c6', 'volume_name': 'volume-b276343b-477c-410b-a7ee-53421604a1c6', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686066ae-a8d1-4270-96d1-b124806d3eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686066ae-a8d1-4270-96d1-b124806d3eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b559fd4-f7ae-4925-8979-619f784e64c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Volume b276343b-477c-410b-a7ee-53421604a1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b276343b-477c-410b-a7ee-53421604a1c6', 'volume_size': 1}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1510498432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b276343b-477c-410b-a7ee-53421604a1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:38Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Creating volume b276343b-477c-410b-a7ee-53421604a1c6 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:37 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:37 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6 1073741824
Jul 19 19:54:37 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:37 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.280s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:54:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Deleted volume successfully.
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b8993c0e-5b63-41f9-8d32-7d1aee1b9820 tempest-VolumeAndVolumeTypeFromImageTest-1289627007 None] Lock "cinder-a839b787-8189-40ae-ad51-6645056a125a-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:38 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6 1073741824" returned: 0 in 0.550s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:38 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6
Jul 19 19:54:38 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:38 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b559fd4-f7ae-4925-8979-619f784e64c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b276343b-477c-410b-a7ee-53421604a1c6', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687904c7-ea63-4f66-9dd4-510da8e8bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:38 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Volume volume-b276343b-477c-410b-a7ee-53421604a1c6 (b276343b-477c-410b-a7ee-53421604a1c6): created successfully
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687904c7-ea63-4f66-9dd4-510da8e8bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (3669151a-f0a0-4372-812d-1507a4256a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-694f2642-8169-402e-81bf-1669451117f5 tempest-VolumesActionsTest-1908232112 None] Created volume successfully.
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Flow 'volume_create_manager' (e53ce482-28b4-472d-aee1-f8f57997cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9af247b-f438-467f-bc07-e5e22fb5f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9af247b-f438-467f-bc07-e5e22fb5f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-963425968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9ab4ca-a8f6-4600-ac74-a8941d94b948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979bcdb7bbf4325a72f90b235ce8ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:39Z,use_quota=True,user_id='d9615920171f40a1881ee1340e1248af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e792cc1-09a6-4b45-8fe4-6f6a3763fd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e792cc1-09a6-4b45-8fe4-6f6a3763fd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f6aba9-e351-4fe1-86cf-dbdbe24edcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f6aba9-e351-4fe1-86cf-dbdbe24edcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba9ab4ca-a8f6-4600-ac74-a8941d94b948', 'volume_name': 'volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d12c0b-b073-49d1-829d-1d8d70472c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d12c0b-b073-49d1-829d-1d8d70472c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7145e598-72b8-42bb-8395-41f6a1a20a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:39 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Volume ba9ab4ca-a8f6-4600-ac74-a8941d94b948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948', 'volume_size': 1}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-963425968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9ab4ca-a8f6-4600-ac74-a8941d94b948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979bcdb7bbf4325a72f90b235ce8ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:39Z,use_quota=True,user_id='d9615920171f40a1881ee1340e1248af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Creating volume ba9ab4ca-a8f6-4600-ac74-a8941d94b948 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:39 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:39 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948 1073741824
Jul 19 19:54:39 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-b276343b-477c-410b-a7ee-53421604a1c6-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Lock "cinder-b276343b-477c-410b-a7ee-53421604a1c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-quobyte-b276343b-477c-410b-a7ee-53421604a1c6" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Lock "cinder-quobyte-b276343b-477c-410b-a7ee-53421604a1c6" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:40 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948 1073741824" returned: 0 in 0.640s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[45173d45-2670-46e6-ba84-fe7a8d2167ff]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:40 devstack sudo[97475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948
Jul 19 19:54:40 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:40 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6
Jul 19 19:54:40 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:40 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7145e598-72b8-42bb-8395-41f6a1a20a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966ef72e-17d8-4655-a361-a120d8dccfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:40 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Volume volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948 (ba9ab4ca-a8f6-4600-ac74-a8941d94b948): created successfully
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966ef72e-17d8-4655-a361-a120d8dccfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Flow 'volume_create_manager' (e53ce482-28b4-472d-aee1-f8f57997cc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0d2fa770-8f17-477e-9ca5-b87f9ffddb9b tempest-AttachVolumeTestJSON-1085432239 None] Created volume successfully.
Jul 19 19:54:40 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6" returned: 0 in 0.544s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:40 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6
Jul 19 19:54:40 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:41 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b276343b-477c-410b-a7ee-53421604a1c6" returned: 0 in 0.292s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Lock "cinder-quobyte-b276343b-477c-410b-a7ee-53421604a1c6" released by "delete_volume" :: held 0.909s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Created reservations ['7a92cf5e-3c4f-402d-898d-e3025376410d', 'f534b756-8c9b-408a-b1a0-5f5749693f20', '6e7245f5-18e6-48e8-8e76-17a822421f2a', '75afcd2a-d7d7-4a27-ac00-fcfc45b7bd3b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:41 devstack sudo[97486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:54:41 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:41 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.366s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:54:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Deleted volume successfully.
Jul 19 19:54:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0a02f568-187b-4a93-8f91-555da6a44de8 tempest-VolumesActionsTest-1239747187 None] Lock "cinder-b276343b-477c-410b-a7ee-53421604a1c6-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (a743e8ef-9150-4a19-b03c-ad67017e4d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60fc633-503d-4e23-9b06-3d98e0298ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60fc633-503d-4e23-9b06-3d98e0298ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1935829287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f987be7b-f944-44f2-8c56-0073a3f67e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:42Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be20292-4ee2-42bd-83be-fbca08f56bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be20292-4ee2-42bd-83be-fbca08f56bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82565da-20a8-4e1b-a4c0-331459bfa10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82565da-20a8-4e1b-a4c0-331459bfa10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f987be7b-f944-44f2-8c56-0073a3f67e30', 'volume_name': 'volume-f987be7b-f944-44f2-8c56-0073a3f67e30', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc2f4df-45d5-4410-bc75-584b144e2013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc2f4df-45d5-4410-bc75-584b144e2013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263b439e-5fe5-4778-b80f-b73bbaacf8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:42 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Volume f987be7b-f944-44f2-8c56-0073a3f67e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f987be7b-f944-44f2-8c56-0073a3f67e30', 'volume_size': 1}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1935829287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f987be7b-f944-44f2-8c56-0073a3f67e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:42Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Creating volume f987be7b-f944-44f2-8c56-0073a3f67e30 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:42 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:42 devstack sudo[97495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30 1073741824
Jul 19 19:54:42 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e0f19cd6-fe18-4f89-809d-bcc2855190dd req-5e1e939c-59b5-48b0-83b6-6569a03f3ddc tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:42 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30 1073741824" returned: 0 in 0.566s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:43 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30
Jul 19 19:54:43 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:43 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30" returned: 0 in 0.285s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e0f19cd6-fe18-4f89-809d-bcc2855190dd req-5e1e939c-59b5-48b0-83b6-6569a03f3ddc tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.603s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e0f19cd6-fe18-4f89-809d-bcc2855190dd req-5e1e939c-59b5-48b0-83b6-6569a03f3ddc tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263b439e-5fe5-4778-b80f-b73bbaacf8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f987be7b-f944-44f2-8c56-0073a3f67e30', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2552e4-0555-49c5-9cb7-70656d2fd8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:43 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Volume volume-f987be7b-f944-44f2-8c56-0073a3f67e30 (f987be7b-f944-44f2-8c56-0073a3f67e30): created successfully
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2552e4-0555-49c5-9cb7-70656d2fd8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (a743e8ef-9150-4a19-b03c-ad67017e4d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-e0f19cd6-fe18-4f89-809d-bcc2855190dd req-5e1e939c-59b5-48b0-83b6-6569a03f3ddc tempest-AttachVolumeTestJSON-1085432239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82524053-79a0-4607-af85-ce524bded09b', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:54:43 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f5267607-f7fa-46d3-919a-8a9239c4d4f8 tempest-VolumesActionsTest-1908232112 None] Created volume successfully.
Jul 19 19:54:43 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-e0f19cd6-fe18-4f89-809d-bcc2855190dd req-5e1e939c-59b5-48b0-83b6-6569a03f3ddc tempest-AttachVolumeTestJSON-1085432239 None] attachment_update completed successfully.
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (650281c2-2bc3-4051-aed5-9821b761fe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa47cc1-3ca1-47b5-922d-fb650b544a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa47cc1-3ca1-47b5-922d-fb650b544a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-391853154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4633ff13-5c92-46c9-af32-e8cad617520a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:44Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3c5af8-5da8-463b-baae-43c6a60cb6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3c5af8-5da8-463b-baae-43c6a60cb6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fadf2009-1eea-4ee5-9e6e-8b5aeb3d27b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fadf2009-1eea-4ee5-9e6e-8b5aeb3d27b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4633ff13-5c92-46c9-af32-e8cad617520a', 'volume_name': 'volume-4633ff13-5c92-46c9-af32-e8cad617520a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464ae4ff-639e-4aaf-a4e3-a9d300445f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464ae4ff-639e-4aaf-a4e3-a9d300445f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d519f57a-b68a-4122-99f4-495df0450d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume 4633ff13-5c92-46c9-af32-e8cad617520a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4633ff13-5c92-46c9-af32-e8cad617520a', 'volume_size': 1}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-391853154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4633ff13-5c92-46c9-af32-e8cad617520a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:44Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Creating volume 4633ff13-5c92-46c9-af32-e8cad617520a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:44 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:44 devstack sudo[97896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a 1073741824
Jul 19 19:54:44 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-f987be7b-f944-44f2-8c56-0073a3f67e30-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Lock "cinder-f987be7b-f944-44f2-8c56-0073a3f67e30-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-quobyte-f987be7b-f944-44f2-8c56-0073a3f67e30" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Flow 'volume_create_manager' (e4fe083a-c7ad-4f0b-81df-13bcd92be7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7584e6a0-a8da-48cd-a496-ce5484985aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Lock "cinder-quobyte-f987be7b-f944-44f2-8c56-0073a3f67e30" acquired by "delete_volume" :: waited 0.054s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7584e6a0-a8da-48cd-a496-ce5484985aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-163752487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d25029-cbd2-4ab3-9f31-4fec78a3f2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c1502a877f42c8b96ca13e0c4294fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:45Z,use_quota=True,user_id='4a4a18304b3a462597441b3c8b2dfc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4624c6a5-44ca-43a1-be8d-083aba835d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4624c6a5-44ca-43a1-be8d-083aba835d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c6bbf4-3878-45d4-9ea7-1784856d828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c6bbf4-3878-45d4-9ea7-1784856d828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d25029-cbd2-4ab3-9f31-4fec78a3f2b8', 'volume_name': 'volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ae6d66-9516-417d-a492-a459b052813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ae6d66-9516-417d-a492-a459b052813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a47f50-d69b-4dd9-b0aa-69be41dc62e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:44 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Volume 90d25029-cbd2-4ab3-9f31-4fec78a3f2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8', 'volume_size': 1}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbeeaef-650e-4a31-b6be-7e370e66d4e6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:44 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a 1073741824" returned: 0 in 0.547s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:44 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30
Jul 19 19:54:44 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:44 devstack sudo[97903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a
Jul 19 19:54:44 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:45 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a" returned: 0 in 0.258s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-163752487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d25029-cbd2-4ab3-9f31-4fec78a3f2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c1502a877f42c8b96ca13e0c4294fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:45Z,use_quota=True,user_id='4a4a18304b3a462597441b3c8b2dfc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Creating volume 90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:45 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:45 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30" returned: 0 in 0.404s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:45 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 1073741824
Jul 19 19:54:45 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d519f57a-b68a-4122-99f4-495df0450d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4633ff13-5c92-46c9-af32-e8cad617520a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0114d384-4635-4597-9da0-e2d921a53588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:45 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30
Jul 19 19:54:45 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:45 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume volume-4633ff13-5c92-46c9-af32-e8cad617520a (4633ff13-5c92-46c9-af32-e8cad617520a): created successfully
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0114d384-4635-4597-9da0-e2d921a53588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (650281c2-2bc3-4051-aed5-9821b761fe61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:45 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-69a3d5d8-acbc-4557-b658-f2b883c5dac6 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created volume successfully.
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Flow 'volume_create_manager' (4c7a4e75-1716-4dd2-93ed-3a6ec416d75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea76db2-93d8-4ee3-b0eb-b0f6dbd66c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:45 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea76db2-93d8-4ee3-b0eb-b0f6dbd66c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-157922759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd38864-06c9-42b0-b2ca-9c90a4c167a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979bcdb7bbf4325a72f90b235ce8ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:45Z,use_quota=True,user_id='d9615920171f40a1881ee1340e1248af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a93443-cf30-4529-baf9-5b9d09505725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a93443-cf30-4529-baf9-5b9d09505725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a5b0a7-63f3-47db-a229-025c5a481195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a5b0a7-63f3-47db-a229-025c5a481195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd38864-06c9-42b0-b2ca-9c90a4c167a4', 'volume_name': 'volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cd89b2-09be-4226-b050-c2a136ec5f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cd89b2-09be-4226-b050-c2a136ec5f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e2eaac-8d10-41a9-8932-64b5841d64a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:45 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Volume ecd38864-06c9-42b0-b2ca-9c90a4c167a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4', 'volume_size': 1}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f987be7b-f944-44f2-8c56-0073a3f67e30" returned: 0 in 0.350s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Lock "cinder-quobyte-f987be7b-f944-44f2-8c56-0073a3f67e30" released by "delete_volume" :: held 0.843s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Created reservations ['92e68878-2c82-4b98-9c99-506ca7605c1e', '4ffac147-e4f7-4c53-8cf2-4bee1edf7507', '81d76d28-f555-4011-86cb-89599470d4a2', '596905df-4e54-43f1-bc0c-94e2194110ea'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:45 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 1073741824" returned: 0 in 0.513s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:45 devstack sudo[97919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:54:45 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:45 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8
Jul 19 19:54:45 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:45 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.263s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:54:45 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Deleted volume successfully.
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0a22dc2-4493-4e55-8267-af14d549cb0f tempest-VolumesActionsTest-1239747187 None] Lock "cinder-f987be7b-f944-44f2-8c56-0073a3f67e30-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:45 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-157922759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd38864-06c9-42b0-b2ca-9c90a4c167a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979bcdb7bbf4325a72f90b235ce8ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:45Z,use_quota=True,user_id='d9615920171f40a1881ee1340e1248af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Creating volume ecd38864-06c9-42b0-b2ca-9c90a4c167a4 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:46 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a47f50-d69b-4dd9-b0aa-69be41dc62e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4 1073741824
Jul 19 19:54:46 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019cf3a6-6130-4346-b541-91d2faa4d324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Volume volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 (90d25029-cbd2-4ab3-9f31-4fec78a3f2b8): created successfully
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019cf3a6-6130-4346-b541-91d2faa4d324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Flow 'volume_create_manager' (e4fe083a-c7ad-4f0b-81df-13bcd92be7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-97b8fc66-83ec-4eae-9a8e-cbae7a9c3dde tempest-VolumesCloneTest-1892845700 None] Created volume successfully.
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (6c1543a2-6e85-4613-8946-0c451d98c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc2aaad-037c-4242-ab02-b10520ec4a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc2aaad-037c-4242-ab02-b10520ec4a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1404800785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165284cb-f6e5-49a6-af8f-1989e0a7fda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:46Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6462f2c1-9a58-4f76-9eae-3dee06542bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6462f2c1-9a58-4f76-9eae-3dee06542bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3c6de9-6069-4299-a416-763d1322c548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3c6de9-6069-4299-a416-763d1322c548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165284cb-f6e5-49a6-af8f-1989e0a7fda0', 'volume_name': 'volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7072d9c1-828f-4a56-a854-ce49d97167c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7072d9c1-828f-4a56-a854-ce49d97167c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca1aad9-2011-455f-8409-4effdd07aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Volume 165284cb-f6e5-49a6-af8f-1989e0a7fda0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0', 'volume_size': 1}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:46 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4 1073741824" returned: 0 in 0.504s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:46 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4
Jul 19 19:54:46 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (727f14da-8f23-4fa8-ba4d-729805aafb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c95764a-3b1f-4c85-9dc9-bdd49ecc4999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c95764a-3b1f-4c85-9dc9-bdd49ecc4999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-755053863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d1a6bc-f46e-4d16-92a9-756e72812484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:47Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e490cb82-72bf-49bc-9d41-ffd912f21e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e490cb82-72bf-49bc-9d41-ffd912f21e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67b35ab-3753-4497-b4e5-e86aa19778bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67b35ab-3753-4497-b4e5-e86aa19778bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d1a6bc-f46e-4d16-92a9-756e72812484', 'volume_name': 'volume-21d1a6bc-f46e-4d16-92a9-756e72812484', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af66292-721d-4d40-888a-c78f76774b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af66292-721d-4d40-888a-c78f76774b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15574ef7-91fc-425d-a143-686081566672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume 21d1a6bc-f46e-4d16-92a9-756e72812484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d1a6bc-f46e-4d16-92a9-756e72812484', 'volume_size': 1}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:46 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4" returned: 0 in 0.308s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1404800785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165284cb-f6e5-49a6-af8f-1989e0a7fda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:46Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Creating volume 165284cb-f6e5-49a6-af8f-1989e0a7fda0 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:46 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:46 devstack sudo[97934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0 1073741824
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e2eaac-8d10-41a9-8932-64b5841d64a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0e9d56-6cca-4d32-95a1-3562617e3e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Volume volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4 (ecd38864-06c9-42b0-b2ca-9c90a4c167a4): created successfully
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0e9d56-6cca-4d32-95a1-3562617e3e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Flow 'volume_create_manager' (4c7a4e75-1716-4dd2-93ed-3a6ec416d75d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-acfb588f-8975-47fd-ba9a-2e2ba25a7242 tempest-AttachVolumeTestJSON-1085432239 None] Created volume successfully.
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (fb6525ac-4fa4-4ae2-8a4b-d220d142b3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbd267b-56fa-4a87-91b4-538e61713398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbd267b-56fa-4a87-91b4-538e61713398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316984577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674198be-1a08-41b8-bc86-4b74297fd0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:47Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba54735-f6c1-4d23-b282-31a7b314a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba54735-f6c1-4d23-b282-31a7b314a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abfc83a-e7cb-406d-a03e-b8783169db90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abfc83a-e7cb-406d-a03e-b8783169db90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '674198be-1a08-41b8-bc86-4b74297fd0e0', 'volume_name': 'volume-674198be-1a08-41b8-bc86-4b74297fd0e0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de08264-72b4-42c2-9c3b-8484463e536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de08264-72b4-42c2-9c3b-8484463e536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2ca2aa-97e8-400b-aa32-6392dbd8a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume 674198be-1a08-41b8-bc86-4b74297fd0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-674198be-1a08-41b8-bc86-4b74297fd0e0', 'volume_size': 1}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Flow 'volume_create_manager' (77d4fbec-077b-4b86-87f9-2f7fd640bdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92642766-1340-4bc9-b2a9-2917ce2cc56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92642766-1340-4bc9-b2a9-2917ce2cc56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1465777380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05a47f9-6241-450f-ba86-418d7dd24ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c1502a877f42c8b96ca13e0c4294fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=90d25029-cbd2-4ab3-9f31-4fec78a3f2b8,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:47Z,use_quota=True,user_id='4a4a18304b3a462597441b3c8b2dfc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4aac6e-f1c0-4466-b2d1-c05727b5a549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4aac6e-f1c0-4466-b2d1-c05727b5a549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bf98cc-c10f-490c-b2ea-2f4c19ef41ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0 1073741824" returned: 0 in 0.684s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bf98cc-c10f-490c-b2ea-2f4c19ef41ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c05a47f9-6241-450f-ba86-418d7dd24ab7', 'volume_name': 'volume-c05a47f9-6241-450f-ba86-418d7dd24ab7', 'volume_size': 2, 'source_volid': '90d25029-cbd2-4ab3-9f31-4fec78a3f2b8', 'source_volstatus': 'available'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae660b20-bb4e-4a23-b7e2-c32187e768fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae660b20-bb4e-4a23-b7e2-c32187e768fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438b3125-e206-40e8-82f6-81105ad4f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Volume c05a47f9-6241-450f-ba86-418d7dd24ab7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c05a47f9-6241-450f-ba86-418d7dd24ab7', 'volume_size': 2, 'source_volid': '90d25029-cbd2-4ab3-9f31-4fec78a3f2b8', 'source_volstatus': 'available'}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:47 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0
Jul 19 19:54:47 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (2d0464ae-e4b9-4f55-bc41-5e7f8d72c45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27210cc-78ad-4a55-ac80-90c9b1f61e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27210cc-78ad-4a55-ac80-90c9b1f61e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878802937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524b8909-1075-4a7d-b05c-c593c9a461a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:48Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5684d204-4a69-475a-9dc8-2ce3798e6efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5684d204-4a69-475a-9dc8-2ce3798e6efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969cac4c-a78c-4010-92cc-5b7d184cd71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969cac4c-a78c-4010-92cc-5b7d184cd71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524b8909-1075-4a7d-b05c-c593c9a461a0', 'volume_name': 'volume-524b8909-1075-4a7d-b05c-c593c9a461a0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e12efa8-1152-4e24-8e25-daddd26fddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e12efa8-1152-4e24-8e25-daddd26fddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399063fb-a767-4881-9e6a-d979ac4454e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:47 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume 524b8909-1075-4a7d-b05c-c593c9a461a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524b8909-1075-4a7d-b05c-c593c9a461a0', 'volume_size': 1}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:47 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0" returned: 0 in 0.306s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.093s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-755053863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d1a6bc-f46e-4d16-92a9-756e72812484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:47Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Creating volume 21d1a6bc-f46e-4d16-92a9-756e72812484 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:47 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:48 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484 1073741824
Jul 19 19:54:48 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca1aad9-2011-455f-8409-4effdd07aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed36328-8288-4d4d-a4a4-3a776685fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Volume volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0 (165284cb-f6e5-49a6-af8f-1989e0a7fda0): created successfully
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed36328-8288-4d4d-a4a4-3a776685fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (6c1543a2-6e85-4613-8946-0c451d98c781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:48 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f1793486-df93-4123-9ff1-193f73f9bcc2 tempest-VolumesActionsTest-1908232112 None] Created volume successfully.
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (a02604a3-a37e-4b2c-9411-c2d7f0ae5d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6e91c5-d1ce-4b3a-9656-f4836e90f79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6e91c5-d1ce-4b3a-9656-f4836e90f79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1054160002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035fcf72-e49d-4294-bcfb-29e032a574ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:48Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce985a-9d5c-4431-b163-2eec090638b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce985a-9d5c-4431-b163-2eec090638b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d3f754-06e7-4895-a193-fa5fc60e01e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d3f754-06e7-4895-a193-fa5fc60e01e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035fcf72-e49d-4294-bcfb-29e032a574ed', 'volume_name': 'volume-035fcf72-e49d-4294-bcfb-29e032a574ed', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911ea0a0-4143-4153-bb06-04d79b3a9e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911ea0a0-4143-4153-bb06-04d79b3a9e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f3d988-d022-4d52-8792-c5ec70c3b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume 035fcf72-e49d-4294-bcfb-29e032a574ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035fcf72-e49d-4294-bcfb-29e032a574ed', 'volume_size': 1}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:48 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484 1073741824" returned: 0 in 0.624s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (cbcd1fbb-3656-45d1-989e-8e20f9400bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26904d-fbd8-4aae-be58-0ee1b9dcb854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26904d-fbd8-4aae-be58-0ee1b9dcb854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276404523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b495c6d-cd13-4c33-b5dc-8dad3839d32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:49Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2a5da6-17cd-4bf8-a312-9e33186c9f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2a5da6-17cd-4bf8-a312-9e33186c9f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a49089-f362-4495-90ab-80f9dda41f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a49089-f362-4495-90ab-80f9dda41f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b495c6d-cd13-4c33-b5dc-8dad3839d32b', 'volume_name': 'volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a136acf6-fbcd-4ce4-b1eb-5d0ecff5a68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a136acf6-fbcd-4ce4-b1eb-5d0ecff5a68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84587c0d-88e2-484f-b268-24770d9733d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:48 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume 4b495c6d-cd13-4c33-b5dc-8dad3839d32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b', 'volume_size': 1}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-165284cb-f6e5-49a6-af8f-1989e0a7fda0-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Lock "cinder-165284cb-f6e5-49a6-af8f-1989e0a7fda0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:48 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484
Jul 19 19:54:48 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-38516079-e116-4fb4-bfa3-f4a248cdf82f req-94a1cd2a-9dba-46ba-ba6b-3222e5649ba9 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Acquiring lock "cinder-quobyte-165284cb-f6e5-49a6-af8f-1989e0a7fda0" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Lock "cinder-quobyte-165284cb-f6e5-49a6-af8f-1989e0a7fda0" acquired by "delete_volume" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ff601-a6c3-43f0-9f3e-4319e04f4e38]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:48 devstack sudo[97962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0
Jul 19 19:54:48 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:48 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316984577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=674198be-1a08-41b8-bc86-4b74297fd0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:47Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Creating volume 674198be-1a08-41b8-bc86-4b74297fd0e0 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:49 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15574ef7-91fc-425d-a143-686081566672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d1a6bc-f46e-4d16-92a9-756e72812484', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea12531-48a4-4ec9-a405-59b592483e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:49 devstack sudo[97965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0 1073741824
Jul 19 19:54:49 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:49 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume volume-21d1a6bc-f46e-4d16-92a9-756e72812484 (21d1a6bc-f46e-4d16-92a9-756e72812484): created successfully
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea12531-48a4-4ec9-a405-59b592483e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (727f14da-8f23-4fa8-ba4d-729805aafb76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-72b26a52-ec02-4762-b78c-360ffeba5d00 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created volume successfully.
Jul 19 19:54:49 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0" returned: 0 in 0.388s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:49 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0
Jul 19 19:54:49 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:49 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-165284cb-f6e5-49a6-af8f-1989e0a7fda0" returned: 0 in 0.245s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:49 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0 1073741824" returned: 0 in 0.466s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Lock "cinder-quobyte-165284cb-f6e5-49a6-af8f-1989e0a7fda0" released by "delete_volume" :: held 0.678s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Created reservations ['af346816-8ac9-4050-9b99-2a12de0be1c3', '48e7f524-8409-4b7f-b292-f083e4989e34', 'bbab0874-5a32-46b2-a3a9-0909eb491000', '1aa3d386-e7d3-46a0-a05d-aa521a597cb4'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:54:49 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0
Jul 19 19:54:49 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:49 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:54:49 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:49 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.169s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:49 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Cloning volume 90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 to volume c05a47f9-6241-450f-ba86-418d7dd24ab7
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2ca2aa-97e8-400b-aa32-6392dbd8a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-674198be-1a08-41b8-bc86-4b74297fd0e0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0f1b85-7c61-4468-bc89-c0b6ec4b8f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:49 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume volume-674198be-1a08-41b8-bc86-4b74297fd0e0 (674198be-1a08-41b8-bc86-4b74297fd0e0): created successfully
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0f1b85-7c61-4468-bc89-c0b6ec4b8f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (fb6525ac-4fa4-4ae2-8a4b-d220d142b3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-14b8267e-23a7-427e-a93b-7ac861e27395 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created volume successfully.
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Creating offline snapshot c66df311-701f-4cc4-ba5e-915f80af6aaa of volume 90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc6aa68-57bb-472c-8b7b-07a6a2957ceb]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:49 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:54:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Deleted volume successfully.
Jul 19 19:54:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e3c6b4b-8982-4a5e-86d3-509f2c3e10eb tempest-VolumesActionsTest-1239747187 None] Lock "cinder-165284cb-f6e5-49a6-af8f-1989e0a7fda0-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:50 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8
Jul 19 19:54:50 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:50 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" returned: 0 in 0.396s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:50 devstack sudo[97989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa 1G
Jul 19 19:54:50 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (6030f467-47b6-4824-a26b-52445f4839ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea538ff-f1a6-4f83-8ade-e78091e057c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea538ff-f1a6-4f83-8ade-e78091e057c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1793972935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c80832-483c-4f78-946e-cd60886082c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:50Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e4dc48-e03c-4e61-a3e4-8fe3e87a6dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e4dc48-e03c-4e61-a3e4-8fe3e87a6dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b5ffaf-d405-4596-8ad0-c0e0a02e19dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b5ffaf-d405-4596-8ad0-c0e0a02e19dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c80832-483c-4f78-946e-cd60886082c8', 'volume_name': 'volume-e8c80832-483c-4f78-946e-cd60886082c8', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c304103-f98c-4208-bf6a-0a665272a4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c304103-f98c-4208-bf6a-0a665272a4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba310f9-9435-42a3-b558-ffefb8f7b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:50 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Volume e8c80832-483c-4f78-946e-cd60886082c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c80832-483c-4f78-946e-cd60886082c8', 'volume_size': 1}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:50 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa 1G" returned: 0 in 0.428s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:50 devstack sudo[97995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa
Jul 19 19:54:50 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:51 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:51 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa is being set with open permissions: ugo+rw
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:51 devstack sudo[98000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa
Jul 19 19:54:51 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:51 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa" returned: 0 in 0.239s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:51 devstack sudo[98003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.info
Jul 19 19:54:51 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:51 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.info" returned: 0 in 0.246s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:51 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.info is being set with open permissions: ugo+rw
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:51 devstack sudo[98006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.info
Jul 19 19:54:51 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:51 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.info" returned: 0 in 0.239s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Acquiring lock "cinder-quobyte-c05a47f9-6241-450f-ba86-418d7dd24ab7" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Lock "cinder-quobyte-c05a47f9-6241-450f-ba86-418d7dd24ab7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] snapshot: c66df311-701f-4cc4-ba5e-915f80af6aaa, volume: c05a47f9-6241-450f-ba86-418d7dd24ab7,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c78dc8-71ae-48a7-9b27-c23d1a5453fd]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:51 devstack sudo[98009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa
Jul 19 19:54:51 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:52 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa" returned: 0 in 0.352s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e94320b-a557-4a68-962c-3275bd354cdf]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:52 devstack sudo[98014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8
Jul 19 19:54:52 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:52 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" returned: 0 in 0.346s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7 not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 19:54:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:52 devstack sudo[98019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7
Jul 19 19:54:52 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:56 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7" returned: 0 in 4.221s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:56 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2667a5-fcab-45f9-95fa-e2861ba1f1b1]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:56 devstack sudo[98032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8
Jul 19 19:54:56 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:57 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" returned: 0 in 0.552s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:54:57 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Converted 1024.00 MB image at 242.54 MB/s
Jul 19 19:54:57 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7 is being set with open permissions: ugo+rw
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:57 devstack sudo[98037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7
Jul 19 19:54:57 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:57 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7" returned: 0 in 0.244s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Lock "cinder-quobyte-c05a47f9-6241-450f-ba86-418d7dd24ab7" released by "_copy_volume_from_snapshot" :: held 5.794s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Acquiring lock "cinder-quobyte-c66df311-701f-4cc4-ba5e-915f80af6aaa" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Lock "cinder-quobyte-c66df311-701f-4cc4-ba5e-915f80af6aaa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Deleting offline snapshot c66df311-701f-4cc4-ba5e-915f80af6aaa of volume 90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] snapshot_file for this snap is: volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e62ecc3-9649-4b33-afb4-afe5e84dea31]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:57 devstack sudo[98040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa
Jul 19 19:54:57 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:58 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa" returned: 0 in 0.351s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed32b79-56cd-428b-baa1-d63b402db960]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:58 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8
Jul 19 19:54:58 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:58 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" returned: 0 in 0.364s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:58 devstack sudo[98051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa
Jul 19 19:54:58 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:58 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa" returned: 0 in 0.320s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:58 devstack sudo[98056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa
Jul 19 19:54:58 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:58 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8.c66df311-701f-4cc4-ba5e-915f80af6aaa" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Lock "cinder-quobyte-c66df311-701f-4cc4-ba5e-915f80af6aaa" released by "_delete_snapshot" :: held 1.383s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.250s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.255s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878802937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524b8909-1075-4a7d-b05c-c593c9a461a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:48Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Creating volume 524b8909-1075-4a7d-b05c-c593c9a461a0 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:59 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438b3125-e206-40e8-82f6-81105ad4f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05a47f9-6241-450f-ba86-418d7dd24ab7', 'volume_size': 2, 'source_volid': '90d25029-cbd2-4ab3-9f31-4fec78a3f2b8', 'source_volstatus': 'available'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:59 devstack sudo[98059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0 1073741824
Jul 19 19:54:59 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1305a1-8512-4185-983a-773e88ed2e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Volume volume-c05a47f9-6241-450f-ba86-418d7dd24ab7 (c05a47f9-6241-450f-ba86-418d7dd24ab7): created successfully
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1305a1-8512-4185-983a-773e88ed2e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Flow 'volume_create_manager' (77d4fbec-077b-4b86-87f9-2f7fd640bdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6b7f3fbf-ae80-4422-aa21-5d3566f9d17f tempest-VolumesCloneTest-1892845700 None] Created volume successfully.
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Acquiring lock "cinder-c05a47f9-6241-450f-ba86-418d7dd24ab7-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Lock "cinder-c05a47f9-6241-450f-ba86-418d7dd24ab7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Acquiring lock "cinder-quobyte-c05a47f9-6241-450f-ba86-418d7dd24ab7" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:54:59 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Lock "cinder-quobyte-c05a47f9-6241-450f-ba86-418d7dd24ab7" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0 1073741824" returned: 0 in 0.492s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5bb258-58fe-4a4b-a096-8abf0a5f68ea]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:59 devstack sudo[98066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0
Jul 19 19:54:59 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:59 devstack sudo[98065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7
Jul 19 19:54:59 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:59 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.554s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1054160002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035fcf72-e49d-4294-bcfb-29e032a574ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:48Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Creating volume 035fcf72-e49d-4294-bcfb-29e032a574ed {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:54:59 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399063fb-a767-4881-9e6a-d979ac4454e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524b8909-1075-4a7d-b05c-c593c9a461a0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:59 devstack sudo[98072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed 1073741824
Jul 19 19:54:59 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4ce2e5-405a-4186-90a5-8c988ad61cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:54:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume volume-524b8909-1075-4a7d-b05c-c593c9a461a0 (524b8909-1075-4a7d-b05c-c593c9a461a0): created successfully
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4ce2e5-405a-4186-90a5-8c988ad61cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (2d0464ae-e4b9-4f55-bc41-5e7f8d72c45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:54:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-22bfc6d8-fcfd-4307-a637-e85c9eddbbc5 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created volume successfully.
Jul 19 19:54:59 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7" returned: 0 in 0.374s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:54:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:54:59 devstack sudo[98075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7
Jul 19 19:54:59 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:00 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c05a47f9-6241-450f-ba86-418d7dd24ab7" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Lock "cinder-quobyte-c05a47f9-6241-450f-ba86-418d7dd24ab7" released by "delete_volume" :: held 0.686s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Created reservations ['e6026b28-1b1b-4e93-abb7-dec6a83932d2', '3c446583-e8dd-42aa-b19b-3a15fe21c84a', 'cb13b64c-7f6f-4b7d-9b89-943f2e27be38', '0155edd4-7b00-4495-b252-d71ed0a2d26e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:00 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed 1073741824" returned: 0 in 0.439s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:00 devstack sudo[98082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed
Jul 19 19:55:00 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:00 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:00 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:00 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.898s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276404523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b495c6d-cd13-4c33-b5dc-8dad3839d32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b840acaeddde411ca792b8a6480c3391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:49Z,use_quota=True,user_id='109d66db5cad462b841bb27af933316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Creating volume 4b495c6d-cd13-4c33-b5dc-8dad3839d32b {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:00 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:00 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.266s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Deleted volume successfully.
Jul 19 19:55:00 devstack sudo[98088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b 1073741824
Jul 19 19:55:00 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f3d988-d022-4d52-8792-c5ec70c3b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035fcf72-e49d-4294-bcfb-29e032a574ed', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88db6ba-14ec-414e-92ce-778e6e6cc33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aa3ddcf0-d21f-4e27-8b2a-495336b4e818 tempest-VolumesCloneTest-1892845700 None] Lock "cinder-c05a47f9-6241-450f-ba86-418d7dd24ab7-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:00 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume volume-035fcf72-e49d-4294-bcfb-29e032a574ed (035fcf72-e49d-4294-bcfb-29e032a574ed): created successfully
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88db6ba-14ec-414e-92ce-778e6e6cc33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (a02604a3-a37e-4b2c-9411-c2d7f0ae5d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Acquiring lock "cinder-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Lock "cinder-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ae911abb-fa00-4c47-8fb4-50097336eb17 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created volume successfully.
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Acquiring lock "cinder-quobyte-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Lock "cinder-quobyte-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b2b65a-d55c-4dea-93b1-b8f5b3a0d316]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:00 devstack sudo[98090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8
Jul 19 19:55:00 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:01 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b 1073741824" returned: 0 in 0.439s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:01 devstack sudo[98095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b
Jul 19 19:55:01 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:01 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" returned: 0 in 0.408s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:01 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8
Jul 19 19:55:01 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:01 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b" returned: 0 in 0.256s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-38516079-e116-4fb4-bfa3-f4a248cdf82f req-94a1cd2a-9dba-46ba-ba6b-3222e5649ba9 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.567s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84587c0d-88e2-484f-b268-24770d9733d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9407f5fd-a428-4baa-a3db-7b3315019d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-38516079-e116-4fb4-bfa3-f4a248cdf82f req-94a1cd2a-9dba-46ba-ba6b-3222e5649ba9 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.918s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1793972935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c80832-483c-4f78-946e-cd60886082c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054629dba2064db2a5a434e134bcd33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:54:50Z,use_quota=True,user_id='ee21d37d5070402f84e4c7df2c38f5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Creating volume e8c80832-483c-4f78-946e-cd60886082c8 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:01 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:01 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Volume volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b (4b495c6d-cd13-4c33-b5dc-8dad3839d32b): created successfully
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9407f5fd-a428-4baa-a3db-7b3315019d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:01 devstack sudo[98106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8 1073741824
Jul 19 19:55:01 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Flow 'volume_create_manager' (cbcd1fbb-3656-45d1-989e-8e20f9400bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:01 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9456ca6c-f0b5-4b4a-b80a-0507b60a763e tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created volume successfully.
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-38516079-e116-4fb4-bfa3-f4a248cdf82f req-94a1cd2a-9dba-46ba-ba6b-3222e5649ba9 tempest-AttachVolumeTestJSON-1085432239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e6c82e5-2e95-4970-b20e-f54ea8608415', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:55:01 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" returned: 0 in 0.300s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Lock "cinder-quobyte-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8" released by "delete_volume" :: held 0.778s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:01 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-38516079-e116-4fb4-bfa3-f4a248cdf82f req-94a1cd2a-9dba-46ba-ba6b-3222e5649ba9 tempest-AttachVolumeTestJSON-1085432239 None] attachment_update completed successfully.
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Created reservations ['131b4c1a-c77d-458f-a511-82a9547a00b7', 'b9d56aec-fba6-4b23-97a2-cf354c95fd74', '32f30902-70d6-452b-93e2-e7cd57ea086d', '87ad491c-93ff-47ad-8448-4f25f86e4391'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:01 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:01 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-4b495c6d-cd13-4c33-b5dc-8dad3839d32b-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-4b495c6d-cd13-4c33-b5dc-8dad3839d32b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-quobyte-4b495c6d-cd13-4c33-b5dc-8dad3839d32b" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-4b495c6d-cd13-4c33-b5dc-8dad3839d32b" acquired by "delete_volume" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[176cdb30-dd62-48c8-ad50-0e89303ecf3f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:02 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8 1073741824" returned: 0 in 0.702s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:02 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.493s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:02 devstack sudo[98220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b
Jul 19 19:55:02 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:02 devstack sudo[98269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8
Jul 19 19:55:02 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Deleted volume successfully.
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bdf38e53-9924-4e76-ba95-71f6e1b3b519 tempest-VolumesCloneTest-1892845700 None] Lock "cinder-90d25029-cbd2-4ab3-9f31-4fec78a3f2b8-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:02 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8" returned: 0 in 0.359s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba310f9-9435-42a3-b558-ffefb8f7b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c80832-483c-4f78-946e-cd60886082c8', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed41dad6-d9af-4b49-929d-813d27fba829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Volume volume-e8c80832-483c-4f78-946e-cd60886082c8 (e8c80832-483c-4f78-946e-cd60886082c8): created successfully
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed41dad6-d9af-4b49-929d-813d27fba829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Flow 'volume_create_manager' (6030f467-47b6-4824-a26b-52445f4839ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5b43161a-5439-4f96-9dab-99c835b867a9 tempest-VolumesActionsTest-1908232112 None] Created volume successfully.
Jul 19 19:55:02 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b" returned: 0 in 0.633s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:02 devstack sudo[98433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b
Jul 19 19:55:02 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:02 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4b495c6d-cd13-4c33-b5dc-8dad3839d32b" returned: 0 in 0.285s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-4b495c6d-cd13-4c33-b5dc-8dad3839d32b" released by "delete_volume" :: held 0.996s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created reservations ['da08e5e7-0570-4daf-bf1a-67cfc7623baa', '7354c6b9-d663-4f3e-9ca9-3dfe0f14c685', '86d50253-ddf3-4504-a4dd-1f88d8ca4c53', 'a6a7508c-4be8-49cd-aa25-4764a696c4ae'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-035fcf72-e49d-4294-bcfb-29e032a574ed-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:03 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:03 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-035fcf72-e49d-4294-bcfb-29e032a574ed-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-quobyte-035fcf72-e49d-4294-bcfb-29e032a574ed" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-035fcf72-e49d-4294-bcfb-29e032a574ed" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0792af-0291-4319-8806-567fe47f07eb]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:03 devstack sudo[98462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed
Jul 19 19:55:03 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:03 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.533s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Deleted volume successfully.
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-51e69992-7f2c-4317-ac61-a647fc6cbd9d tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-4b495c6d-cd13-4c33-b5dc-8dad3839d32b-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-f369f10c-5194-4008-94a6-a3e89dab88ee req-0c518b3e-f56d-4d38-9a6b-a098444fc694 tempest-AttachVolumeTestJSON-1085432239 None] Terminate volume connection completed successfully.
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-f369f10c-5194-4008-94a6-a3e89dab88ee req-0c518b3e-f56d-4d38-9a6b-a098444fc694 tempest-AttachVolumeTestJSON-1085432239 None] Deleting attachment 82524053-79a0-4607-af85-ce524bded09b. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:55:03 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed" returned: 0 in 0.556s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:04 devstack sudo[98495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed
Jul 19 19:55:04 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:04 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-035fcf72-e49d-4294-bcfb-29e032a574ed" returned: 0 in 0.337s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-035fcf72-e49d-4294-bcfb-29e032a574ed" released by "delete_volume" :: held 0.984s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "cinder-e8c80832-483c-4f78-946e-cd60886082c8-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-e8c80832-483c-4f78-946e-cd60886082c8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created reservations ['b198e09e-a5bc-44e5-a7f7-97fad544852a', 'c186f416-7be5-493b-9e9a-6132b8a28c9c', '09ed1f59-65d1-43b2-b3e2-71a5e6e39366', '9aa953a7-8bfc-4461-9a63-353ce62de248'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "cinder-quobyte-e8c80832-483c-4f78-946e-cd60886082c8" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-quobyte-e8c80832-483c-4f78-946e-cd60886082c8" acquired by "delete_volume" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5709de-e78e-4f83-a01a-6c0951b699f2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:04 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:04 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:04 devstack sudo[98498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8
Jul 19 19:55:04 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:04 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.306s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:04 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Deleted volume successfully.
Jul 19 19:55:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d40fbd09-5503-4540-85ef-7ec3410bab0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-035fcf72-e49d-4294-bcfb-29e032a574ed-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:05 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8" returned: 0 in 0.529s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:05 devstack sudo[98507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8
Jul 19 19:55:05 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:05 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e8c80832-483c-4f78-946e-cd60886082c8" returned: 0 in 0.329s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:05 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-51df7ac6-05cd-44bd-bf97-6a1772a793c7 req-92e53cc1-4c9b-4b67-899f-8cab0d592ce9 tempest-AttachVolumeTestJSON-1085432239 None] Terminate volume connection completed successfully.
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-51df7ac6-05cd-44bd-bf97-6a1772a793c7 req-92e53cc1-4c9b-4b67-899f-8cab0d592ce9 tempest-AttachVolumeTestJSON-1085432239 None] Deleting attachment 0e6c82e5-2e95-4970-b20e-f54ea8608415. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-quobyte-e8c80832-483c-4f78-946e-cd60886082c8" released by "delete_volume" :: held 0.928s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Created reservations ['b5c237f3-502a-43b1-a02c-072c0e7ae3a3', '2f3bc3ea-81e6-4492-a8d0-dc8602904c5d', 'a29ded8d-31b6-467e-bea3-eb3e0005491b', '7272683b-12dd-4b42-b0d1-56cace23db03'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:05 devstack sudo[98513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:05 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-524b8909-1075-4a7d-b05c-c593c9a461a0-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-524b8909-1075-4a7d-b05c-c593c9a461a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-quobyte-524b8909-1075-4a7d-b05c-c593c9a461a0" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-524b8909-1075-4a7d-b05c-c593c9a461a0" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3435b5a-d123-45cf-9d9a-16bcf5d32aa4]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:05 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:05 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Deleted volume successfully.
Jul 19 19:55:05 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0
Jul 19 19:55:05 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-77d0fac7-abd9-481a-aac6-669e9c02db72 tempest-VolumesActionsTest-1908232112 None] Lock "cinder-e8c80832-483c-4f78-946e-cd60886082c8-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Flow 'volume_create_manager' (6c121216-ec40-454a-9a8c-07ee195b1776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd93e20-0245-4b23-8975-e94dee0f65ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd93e20-0245-4b23-8975-e94dee0f65ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1444286576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558e4c92-f702-4a19-84e3-d64ea3f52fd4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e3c8e7ccb274f3cb347b28750899cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:06Z,use_quota=True,user_id='6de33c4f19a0490f85049c0a716a66aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c835e0-b72a-4453-8e2f-ff623c2d9f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c835e0-b72a-4453-8e2f-ff623c2d9f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:06 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b958a74f-7725-4154-a37a-dafabd7d0246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b958a74f-7725-4154-a37a-dafabd7d0246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558e4c92-f702-4a19-84e3-d64ea3f52fd4', 'volume_name': 'volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c625f3b-5df8-477b-8725-9a6e4a0a0f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c625f3b-5df8-477b-8725-9a6e4a0a0f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c737508-e323-4bb7-8b85-8fa457e29418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:06 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Volume 558e4c92-f702-4a19-84e3-d64ea3f52fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4', 'volume_size': 1}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1444286576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558e4c92-f702-4a19-84e3-d64ea3f52fd4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e3c8e7ccb274f3cb347b28750899cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:06Z,use_quota=True,user_id='6de33c4f19a0490f85049c0a716a66aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Creating volume 558e4c92-f702-4a19-84e3-d64ea3f52fd4 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:06 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0" returned: 0 in 0.603s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:06 devstack sudo[98521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4 1073741824
Jul 19 19:55:06 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:06 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0
Jul 19 19:55:06 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:06 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-524b8909-1075-4a7d-b05c-c593c9a461a0" returned: 0 in 0.307s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-524b8909-1075-4a7d-b05c-c593c9a461a0" released by "delete_volume" :: held 0.965s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created reservations ['a75add59-a2c0-4a3c-b137-d423093dbf9d', 'c30ca129-3e47-4dea-b058-805496ae1af3', 'e0a374a2-5c93-4fc8-a203-d847ae1e364e', '430dd48c-05eb-4870-964f-7b3eb1c2b999'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:06 devstack sudo[98530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:06 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:07 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4 1073741824" returned: 0 in 0.745s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:07 devstack sudo[98536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4
Jul 19 19:55:07 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:07 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.501s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:07 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Deleted volume successfully.
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-40794d95-a722-4ddc-bbe5-bc252c4c74af tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-524b8909-1075-4a7d-b05c-c593c9a461a0-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:07 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4" returned: 0 in 0.483s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c737508-e323-4bb7-8b85-8fa457e29418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5498c896-1960-4f36-b89c-1738823b354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:07 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Volume volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4 (558e4c92-f702-4a19-84e3-d64ea3f52fd4): created successfully
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5498c896-1960-4f36-b89c-1738823b354a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Flow 'volume_create_manager' (6c121216-ec40-454a-9a8c-07ee195b1776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:07 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-50d54c8a-a38e-4f4d-a900-797f9842cc12 tempest-VolumesListTestJSON-1527076097 None] Created volume successfully.
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-674198be-1a08-41b8-bc86-4b74297fd0e0-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-674198be-1a08-41b8-bc86-4b74297fd0e0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-quobyte-674198be-1a08-41b8-bc86-4b74297fd0e0" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-674198be-1a08-41b8-bc86-4b74297fd0e0" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:08 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3e84d0-55ec-4253-93b2-e44e14688799]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:08 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0
Jul 19 19:55:08 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:08 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0" returned: 0 in 0.622s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:08 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0
Jul 19 19:55:08 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:09 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Flow 'volume_create_manager' (f4670334-c3cb-467f-8789-dcdb128df88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7525de5d-d203-437d-bd4a-02babb52318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-674198be-1a08-41b8-bc86-4b74297fd0e0" returned: 0 in 0.537s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7525de5d-d203-437d-bd4a-02babb52318d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-500921036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4abf6ce-700a-4a3b-9bff-1ebe179b44f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e3c8e7ccb274f3cb347b28750899cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:09Z,use_quota=True,user_id='6de33c4f19a0490f85049c0a716a66aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d41f9e2-2f52-40e7-a890-ccec036cd33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d41f9e2-2f52-40e7-a890-ccec036cd33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001bacc7-72fe-4bc4-b92d-ca3d99c07187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001bacc7-72fe-4bc4-b92d-ca3d99c07187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4abf6ce-700a-4a3b-9bff-1ebe179b44f0', 'volume_name': 'volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98848b83-45f4-4f16-ac20-d91b2b23b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98848b83-45f4-4f16-ac20-d91b2b23b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82780ddd-08b1-4d3e-b00b-0b1d6afc269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:09 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Volume d4abf6ce-700a-4a3b-9bff-1ebe179b44f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0', 'volume_size': 1}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-500921036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4abf6ce-700a-4a3b-9bff-1ebe179b44f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e3c8e7ccb274f3cb347b28750899cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:09Z,use_quota=True,user_id='6de33c4f19a0490f85049c0a716a66aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Creating volume d4abf6ce-700a-4a3b-9bff-1ebe179b44f0 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:09 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-674198be-1a08-41b8-bc86-4b74297fd0e0" released by "delete_volume" :: held 1.315s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:09 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0 1073741824
Jul 19 19:55:09 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created reservations ['98533ec0-2ddd-46be-bd88-5286d67fc5c0', 'ce1bdc50-645f-4750-992a-9470000a53bd', '4d8606c6-cda1-46d6-b86c-f6b48147e4b5', 'cbdf79bc-da27-4198-b63f-5009ca3a7bfb'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:09 devstack sudo[98573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:09 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:10 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:10 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.472s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0 1073741824" returned: 0 in 0.722s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Deleted volume successfully.
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2f6384e8-1e37-4afc-8048-af14a0f2438f tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-674198be-1a08-41b8-bc86-4b74297fd0e0-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:10 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0
Jul 19 19:55:10 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-21d1a6bc-f46e-4d16-92a9-756e72812484-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-21d1a6bc-f46e-4d16-92a9-756e72812484-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-quobyte-21d1a6bc-f46e-4d16-92a9-756e72812484" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-21d1a6bc-f46e-4d16-92a9-756e72812484" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:10 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0" returned: 0 in 0.331s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82780ddd-08b1-4d3e-b00b-0b1d6afc269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8782144-26df-476f-8622-0dae6608ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc502b-db21-4745-89c8-c64ae6c44231]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:10 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Volume volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0 (d4abf6ce-700a-4a3b-9bff-1ebe179b44f0): created successfully
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8782144-26df-476f-8622-0dae6608ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Flow 'volume_create_manager' (f4670334-c3cb-467f-8789-dcdb128df88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-683f5f44-cc12-49a9-9e96-a23934348553 tempest-VolumesListTestJSON-1527076097 None] Created volume successfully.
Jul 19 19:55:10 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484
Jul 19 19:55:10 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:10 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484" returned: 0 in 0.476s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:10 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484
Jul 19 19:55:10 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:11 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-21d1a6bc-f46e-4d16-92a9-756e72812484" returned: 0 in 0.349s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-21d1a6bc-f46e-4d16-92a9-756e72812484" released by "delete_volume" :: held 0.894s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created reservations ['190b20f9-b218-4a56-99da-7232fbb3dc0c', '2499f966-963d-4284-b62c-c3e8d94aa165', 'fa1729cd-e700-4428-be12-8ac7b97d3b07', '857e81c4-4dd6-45c6-aff3-40affb4eeca2'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:11 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:11 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-4633ff13-5c92-46c9-af32-e8cad617520a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-4633ff13-5c92-46c9-af32-e8cad617520a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "cinder-quobyte-4633ff13-5c92-46c9-af32-e8cad617520a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-4633ff13-5c92-46c9-af32-e8cad617520a" acquired by "delete_volume" :: waited 0.063s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0450e72-e00b-4c3c-8b6e-f2197f207c07]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Flow 'volume_create_manager' (04efc58c-92bf-41b4-b946-1ab734dcc34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91df7d6-8f7a-4604-9316-21968fff3711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91df7d6-8f7a-4604-9316-21968fff3711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-979692927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a880806d-6768-4109-bf87-0f37b37d9a6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e3c8e7ccb274f3cb347b28750899cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:12Z,use_quota=True,user_id='6de33c4f19a0490f85049c0a716a66aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff06012-992c-4cac-bf3e-0432e6602457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff06012-992c-4cac-bf3e-0432e6602457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4e9b42-4152-4ea0-a1bd-0284458196d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:12 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4e9b42-4152-4ea0-a1bd-0284458196d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a880806d-6768-4109-bf87-0f37b37d9a6a', 'volume_name': 'volume-a880806d-6768-4109-bf87-0f37b37d9a6a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8192649-4cc1-4750-a1e0-101ac8f2b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8192649-4cc1-4750-a1e0-101ac8f2b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287c0c6c-96a7-452e-8f47-720f889b6728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:12 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Volume a880806d-6768-4109-bf87-0f37b37d9a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a880806d-6768-4109-bf87-0f37b37d9a6a', 'volume_size': 1}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-979692927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a880806d-6768-4109-bf87-0f37b37d9a6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e3c8e7ccb274f3cb347b28750899cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:12Z,use_quota=True,user_id='6de33c4f19a0490f85049c0a716a66aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Creating volume a880806d-6768-4109-bf87-0f37b37d9a6a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:12 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.579s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:12 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Deleted volume successfully.
Jul 19 19:55:12 devstack sudo[98595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a
Jul 19 19:55:12 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a 1073741824
Jul 19 19:55:12 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:12 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d2262bae-bb95-42c6-9a8b-919f927a16f0 tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-21d1a6bc-f46e-4d16-92a9-756e72812484-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "cinder-ecd38864-06c9-42b0-b2ca-9c90a4c167a4-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-ecd38864-06c9-42b0-b2ca-9c90a4c167a4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "cinder-quobyte-ecd38864-06c9-42b0-b2ca-9c90a4c167a4" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-quobyte-ecd38864-06c9-42b0-b2ca-9c90a4c167a4" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d4a9e-e981-4582-b390-a1eb96fb64b7]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:12 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a" returned: 0 in 0.527s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:12 devstack sudo[98600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4
Jul 19 19:55:12 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:12 devstack sudo[98606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a
Jul 19 19:55:12 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:12 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a 1073741824" returned: 0 in 0.617s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:12 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4633ff13-5c92-46c9-af32-e8cad617520a" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-quobyte-4633ff13-5c92-46c9-af32-e8cad617520a" released by "delete_volume" :: held 0.872s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:12 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4" returned: 0 in 0.457s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:12 devstack sudo[98615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a
Jul 19 19:55:12 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:12 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4
Jul 19 19:55:12 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Created reservations ['1ae1bd93-7e1c-4842-aab1-fb7cf6680638', '02d0d69a-9f08-4205-916a-b295503a51ab', '30406a52-9419-4ce1-be48-9379fe41fdf5', '8b55546a-9b09-470e-856d-73a1ed357996'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:13 devstack sudo[98621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:13 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:13 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a" returned: 0 in 0.326s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287c0c6c-96a7-452e-8f47-720f889b6728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a880806d-6768-4109-bf87-0f37b37d9a6a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce8a6cc-6463-4b90-8f19-40b76daba064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:13 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Volume volume-a880806d-6768-4109-bf87-0f37b37d9a6a (a880806d-6768-4109-bf87-0f37b37d9a6a): created successfully
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce8a6cc-6463-4b90-8f19-40b76daba064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Flow 'volume_create_manager' (04efc58c-92bf-41b4-b946-1ab734dcc34a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b9acb6d1-b0c8-449d-9870-9a462af73333 tempest-VolumesListTestJSON-1527076097 None] Created volume successfully.
Jul 19 19:55:13 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ecd38864-06c9-42b0-b2ca-9c90a4c167a4" returned: 0 in 0.395s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-quobyte-ecd38864-06c9-42b0-b2ca-9c90a4c167a4" released by "delete_volume" :: held 0.904s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Created reservations ['870547f3-726a-4b81-af5b-faab506c723a', 'c638a866-603d-4363-b4ca-b908f38ebc6e', 'cea8aa7b-4b45-4c16-99fb-002cbf852a97', 'c7213b08-17c9-4b1d-9686-e5479bc8ac61'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:13 devstack sudo[98625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:13 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:13 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "cinder-ba9ab4ca-a8f6-4600-ac74-a8941d94b948-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.376s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Deleted volume successfully.
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-ba9ab4ca-a8f6-4600-ac74-a8941d94b948-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2649dc3b-fb48-4097-b695-4da657913d0b tempest-CreateVolumesFromSourceVolumeTest-907735477 None] Lock "cinder-4633ff13-5c92-46c9-af32-e8cad617520a-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "cinder-quobyte-ba9ab4ca-a8f6-4600-ac74-a8941d94b948" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-quobyte-ba9ab4ca-a8f6-4600-ac74-a8941d94b948" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e977d404-700a-432d-b556-92031260528d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:13 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Deleted volume successfully.
Jul 19 19:55:13 devstack sudo[98627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948
Jul 19 19:55:13 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-192241d1-2b00-4ea4-8332-546af1600592 tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-ecd38864-06c9-42b0-b2ca-9c90a4c167a4-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:13 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948" returned: 0 in 0.434s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:14 devstack sudo[98634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948
Jul 19 19:55:14 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:14 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ba9ab4ca-a8f6-4600-ac74-a8941d94b948" returned: 0 in 0.360s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-quobyte-ba9ab4ca-a8f6-4600-ac74-a8941d94b948" released by "delete_volume" :: held 0.843s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=213,cinder:DELETE=20,cinder:SELECT=163,cinder:INSERT=49 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=158,cinder:UPDATE=201,cinder:INSERT=53,cinder:DELETE=17 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Created reservations ['9969f1e3-9c81-485a-bff8-1f596fe8550f', 'e5ebd418-4ee1-478c-9baa-24f57e0f0e7b', '26e7c6ed-9667-470f-9c06-a3bcd00f287a', '83496cd1-e22d-48a7-b8b7-207b24c0fd66'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:14 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:14 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:14 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.291s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:14 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Deleted volume successfully.
Jul 19 19:55:14 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35c6c0ac-9dd1-4aba-aeb6-7c28fc0ed1fc tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-ba9ab4ca-a8f6-4600-ac74-a8941d94b948-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "cinder-c25b1fea-1ca5-4fae-ac61-2ede0819ced7-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-c25b1fea-1ca5-4fae-ac61-2ede0819ced7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "cinder-quobyte-c25b1fea-1ca5-4fae-ac61-2ede0819ced7" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-quobyte-c25b1fea-1ca5-4fae-ac61-2ede0819ced7" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e159d24-447c-418a-bea0-2c385ed56a01]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:16 devstack sudo[98641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7
Jul 19 19:55:16 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:16 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7" returned: 0 in 0.425s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:16 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7
Jul 19 19:55:16 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:16 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c25b1fea-1ca5-4fae-ac61-2ede0819ced7" returned: 0 in 0.292s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-quobyte-c25b1fea-1ca5-4fae-ac61-2ede0819ced7" released by "delete_volume" :: held 0.782s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Created reservations ['2d5ec406-15aa-44e3-80b6-ce9bd2200b4c', '81f2dc0d-29bc-4063-8265-654eaa99a336', '876e04ea-15ab-44db-ab87-3e9c01601566', '3dc1684f-a68f-4140-9285-590c835e8e84'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:17 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:17 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "cinder-a880806d-6768-4109-bf87-0f37b37d9a6a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-a880806d-6768-4109-bf87-0f37b37d9a6a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "cinder-quobyte-a880806d-6768-4109-bf87-0f37b37d9a6a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:17 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-quobyte-a880806d-6768-4109-bf87-0f37b37d9a6a" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.538s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Deleted volume successfully.
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee4f80-8794-4afe-8cb0-33e769220588]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-81aa336f-af5e-4158-8261-053e8d3f387a tempest-AttachVolumeTestJSON-1085432239 None] Lock "cinder-c25b1fea-1ca5-4fae-ac61-2ede0819ced7-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:17 devstack sudo[98653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a
Jul 19 19:55:17 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:18 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a" returned: 0 in 0.462s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:18 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a
Jul 19 19:55:18 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:18 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a880806d-6768-4109-bf87-0f37b37d9a6a" returned: 0 in 0.411s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-quobyte-a880806d-6768-4109-bf87-0f37b37d9a6a" released by "delete_volume" :: held 0.952s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Flow 'volume_create_manager' (d3143b2f-a238-40d4-8e5b-b3b7ae7d4d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbbda7f-2aba-43d0-9eea-559412e882b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbbda7f-2aba-43d0-9eea-559412e882b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1961309642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e129d3d-7065-4547-9387-2e5726d8b26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d412a31a7b46a9a7e42f706c5eab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:18Z,use_quota=True,user_id='dd11f87177464ba7810de5d4f8c4b627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a10ca0-7987-4fa1-91e9-4ec30e031e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a10ca0-7987-4fa1-91e9-4ec30e031e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78276a1a-ed17-48ee-b5b4-3eacfbedc9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78276a1a-ed17-48ee-b5b4-3eacfbedc9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e129d3d-7065-4547-9387-2e5726d8b26a', 'volume_name': 'volume-6e129d3d-7065-4547-9387-2e5726d8b26a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c63dc90-b7a8-4f2e-b26e-49f6d34fc65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c63dc90-b7a8-4f2e-b26e-49f6d34fc65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb61a3-6553-493e-992e-4a1afeec9c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:18 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Volume 6e129d3d-7065-4547-9387-2e5726d8b26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e129d3d-7065-4547-9387-2e5726d8b26a', 'volume_size': 1}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1961309642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e129d3d-7065-4547-9387-2e5726d8b26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d412a31a7b46a9a7e42f706c5eab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:18Z,use_quota=True,user_id='dd11f87177464ba7810de5d4f8c4b627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Creating volume 6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:18 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Created reservations ['7b4542d0-7a5d-4bff-825e-2b812a715e68', '1bca120e-1672-4772-8af3-589971ed9917', '45d9b8ed-a3b4-4819-9b3b-27eb02e49561', '4ae3b176-297a-4077-85ee-6a9c147d2e36'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:18 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a 1073741824
Jul 19 19:55:18 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:18 devstack sudo[98663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:18 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:19 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.315s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Deleted volume successfully.
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3604245b-31c1-4397-ad6e-63cf6ddba255 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-a880806d-6768-4109-bf87-0f37b37d9a6a-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:19 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a 1073741824" returned: 0 in 0.662s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:19 devstack sudo[98791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a
Jul 19 19:55:19 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:19 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a" returned: 0 in 0.396s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "cinder-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb61a3-6553-493e-992e-4a1afeec9c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e129d3d-7065-4547-9387-2e5726d8b26a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21765af4-2984-4ae5-88ac-e646de4cbb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:19 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Volume volume-6e129d3d-7065-4547-9387-2e5726d8b26a (6e129d3d-7065-4547-9387-2e5726d8b26a): created successfully
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21765af4-2984-4ae5-88ac-e646de4cbb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Flow 'volume_create_manager' (d3143b2f-a238-40d4-8e5b-b3b7ae7d4d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e99e78fb-d1db-447a-b6f4-2ddbacce6868 tempest-VolumeDependencyTests-1408449768 None] Created volume successfully.
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "cinder-quobyte-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-quobyte-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c043233a-5bf1-49f9-b1c4-c77bd627d801]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:20 devstack sudo[98796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0
Jul 19 19:55:20 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:20 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0" returned: 0 in 0.462s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:20 devstack sudo[98801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0
Jul 19 19:55:20 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:20 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0" returned: 0 in 0.305s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-quobyte-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0" released by "delete_volume" :: held 0.834s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:20 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Created reservations ['ab05d45f-fb17-4f18-8007-3d2214d39e5f', '4de4e182-d947-402f-a251-e25380203a70', '54447c98-8368-4d12-af14-7bd7fc96ac9f', '461b2ef6-c3c5-43b7-a31e-d3e41b506d42'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Creating offline snapshot 9affe7d0-59bc-4a02-afa7-a75d80515250 of volume 6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eba9bcf-ba6e-4277-8416-9a0139af3646]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:21 devstack sudo[98805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:21 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:21 devstack sudo[98804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a
Jul 19 19:55:21 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:21 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.302s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:21 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Deleted volume successfully.
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ffe87cd-195a-45c2-99ce-5f013b4ec634 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-d4abf6ce-700a-4a3b-9bff-1ebe179b44f0-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:21 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a" returned: 0 in 0.537s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:21 devstack sudo[98812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 1G
Jul 19 19:55:21 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:22 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 1G" returned: 0 in 0.496s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e129d3d-7065-4547-9387-2e5726d8b26a -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:22 devstack sudo[98819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e129d3d-7065-4547-9387-2e5726d8b26a -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250
Jul 19 19:55:22 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "cinder-558e4c92-f702-4a19-84e3-d64ea3f52fd4-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-558e4c92-f702-4a19-84e3-d64ea3f52fd4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "cinder-quobyte-558e4c92-f702-4a19-84e3-d64ea3f52fd4" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-quobyte-558e4c92-f702-4a19-84e3-d64ea3f52fd4" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e36d0-3811-4d82-bc51-af5f802057de]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:22 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e129d3d-7065-4547-9387-2e5726d8b26a -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250" returned: 0 in 0.429s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:22 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 is being set with open permissions: ugo+rw
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:22 devstack sudo[98825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250
Jul 19 19:55:22 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:22 devstack sudo[98824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4
Jul 19 19:55:22 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:22 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250" returned: 0 in 0.304s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:22 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4" returned: 0 in 0.441s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:22 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.info
Jul 19 19:55:22 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:22 devstack sudo[98833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4
Jul 19 19:55:22 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:23 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-558e4c92-f702-4a19-84e3-d64ea3f52fd4" returned: 0 in 0.331s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:23 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.info" returned: 0 in 0.370s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:23 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.info is being set with open permissions: ugo+rw
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-quobyte-558e4c92-f702-4a19-84e3-d64ea3f52fd4" released by "delete_volume" :: held 0.844s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:23 devstack sudo[98838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.info
Jul 19 19:55:23 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Created reservations ['498d8a27-e715-408d-ab9a-4150fc2701f2', '3de32fa3-6f87-4c29-970d-40602dd4b2b1', '1c82c31b-517b-4fe9-a9b4-194cfc7cde79', '70fcb094-725f-4b16-bc6e-8b84d6b8ca99'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:23 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:23 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:23 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.info" returned: 0 in 0.356s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-27b1d1be-0b29-4739-97ee-3134f2243fd5 tempest-VolumeDependencyTests-1408449768 None] Create snapshot completed successfully
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Flow 'volume_create_manager' (e1a30e61-2c9d-4678-b7e2-0b9626ba4726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e564203-2b92-4dfb-8cbb-c0c0a8038e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:23 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.306s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e564203-2b92-4dfb-8cbb-c0c0a8038e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2087641144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f82a605-0b43-4b3a-9be5-6f69809a2ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527d119886b54fd1a230fc1edac62615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:24Z,use_quota=True,user_id='76c6b5892e4744c8b1dc9dddd4fc2a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c439536c-b72a-460b-9b1d-1d95dc1a501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c439536c-b72a-460b-9b1d-1d95dc1a501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b2b276-0753-43fb-86d1-a1a0a8af2ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b2b276-0753-43fb-86d1-a1a0a8af2ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f82a605-0b43-4b3a-9be5-6f69809a2ca4', 'volume_name': 'volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd915feb-da03-4ce2-8726-c69fefe30415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd915feb-da03-4ce2-8726-c69fefe30415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a26ffb-1f03-44c2-a5bb-d5b938391a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:23 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Volume 8f82a605-0b43-4b3a-9be5-6f69809a2ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4', 'volume_size': 1}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2087641144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f82a605-0b43-4b3a-9be5-6f69809a2ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527d119886b54fd1a230fc1edac62615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:24Z,use_quota=True,user_id='76c6b5892e4744c8b1dc9dddd4fc2a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Creating volume 8f82a605-0b43-4b3a-9be5-6f69809a2ca4 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:23 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Deleted volume successfully.
Jul 19 19:55:23 devstack sudo[98845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 1073741824
Jul 19 19:55:23 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-cbad6d07-7dc1-49be-88d8-104c8b5a9163 tempest-VolumesListTestJSON-1527076097 None] Lock "cinder-558e4c92-f702-4a19-84e3-d64ea3f52fd4-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:24 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 1073741824" returned: 0 in 0.568s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:24 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4
Jul 19 19:55:24 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Flow 'volume_create_manager' (73f26b3a-6fa2-48cc-9a91-ce9b943ec28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfedceb-4be9-47b9-bc53-2c7d1ad67ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfedceb-4be9-47b9-bc53-2c7d1ad67ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1895090932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741b1fa8-4e58-4515-8eaa-37815ac98895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d412a31a7b46a9a7e42f706c5eab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9affe7d0-59bc-4a02-afa7-a75d80515250,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:25Z,use_quota=True,user_id='dd11f87177464ba7810de5d4f8c4b627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f69a5b-b79b-44ac-ba34-9fab01324a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f69a5b-b79b-44ac-ba34-9fab01324a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd15eba6-8726-46e9-b485-dae9768d74e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd15eba6-8726-46e9-b485-dae9768d74e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '741b1fa8-4e58-4515-8eaa-37815ac98895', 'volume_name': 'volume-741b1fa8-4e58-4515-8eaa-37815ac98895', 'volume_size': 1, 'snapshot_id': '9affe7d0-59bc-4a02-afa7-a75d80515250'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3182e927-56c9-44f1-b8c1-40c12a6442e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3182e927-56c9-44f1-b8c1-40c12a6442e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44c4cc5-e0f9-498a-8d02-04aed37a7e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:24 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Volume 741b1fa8-4e58-4515-8eaa-37815ac98895: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-741b1fa8-4e58-4515-8eaa-37815ac98895', 'volume_size': 1, 'snapshot_id': '9affe7d0-59bc-4a02-afa7-a75d80515250'}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:24 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" returned: 0 in 0.399s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-quobyte-9affe7d0-59bc-4a02-afa7-a75d80515250-741b1fa8-4e58-4515-8eaa-37815ac98895" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a26ffb-1f03-44c2-a5bb-d5b938391a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0f1332-e720-4047-a735-fc8d5b7bbec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-9affe7d0-59bc-4a02-afa7-a75d80515250-741b1fa8-4e58-4515-8eaa-37815ac98895" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Creating volume 741b1fa8-4e58-4515-8eaa-37815ac98895 from snapshot 9affe7d0-59bc-4a02-afa7-a75d80515250 {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-quobyte-741b1fa8-4e58-4515-8eaa-37815ac98895" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:24 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Volume volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 (8f82a605-0b43-4b3a-9be5-6f69809a2ca4): created successfully
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0f1332-e720-4047-a735-fc8d5b7bbec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Flow 'volume_create_manager' (e1a30e61-2c9d-4678-b7e2-0b9626ba4726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-741b1fa8-4e58-4515-8eaa-37815ac98895" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] snapshot: 9affe7d0-59bc-4a02-afa7-a75d80515250, volume: 741b1fa8-4e58-4515-8eaa-37815ac98895,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 19:55:24 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-499be845-4ea9-465f-a02a-0158d8228e0a tempest-SnapshotMetadataTestJSON-256972045 None] Created volume successfully.
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2332d0-3020-41e9-836a-d2b50e0fec76]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:25 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250
Jul 19 19:55:25 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:25 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250" returned: 0 in 0.418s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e129d3d-7065-4547-9387-2e5726d8b26a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa2298d-6214-47f8-bcf1-67eac04823f4]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:25 devstack sudo[98859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a
Jul 19 19:55:25 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:25 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a" returned: 0 in 0.448s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895 not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 19:55:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:25 devstack sudo[98865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895
Jul 19 19:55:25 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Flow 'volume_create_manager' (d019ff44-7c32-435d-9dcb-98be815cf4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae45c8ac-c46a-47a5-bd83-092e63616ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae45c8ac-c46a-47a5-bd83-092e63616ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-537939501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2712eeee-3ca1-4f30-863f-438d98d3ff83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55977811b16847a3ab6f1140e9c0fd71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:28Z,use_quota=True,user_id='bc371e90970a4daeae532fde77215192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc0ffdd-fb92-4e87-8375-8a1854c4f21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc0ffdd-fb92-4e87-8375-8a1854c4f21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06a4b43-682a-4f40-bbea-552b46a5f92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06a4b43-682a-4f40-bbea-552b46a5f92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2712eeee-3ca1-4f30-863f-438d98d3ff83', 'volume_name': 'volume-2712eeee-3ca1-4f30-863f-438d98d3ff83', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade52330-dd77-4715-a217-3cac0df10038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade52330-dd77-4715-a217-3cac0df10038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015bee63-1cf1-4311-b6c7-d5b43402a41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:28 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Volume 2712eeee-3ca1-4f30-863f-438d98d3ff83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2712eeee-3ca1-4f30-863f-438d98d3ff83', 'volume_size': 1}
Jul 19 19:55:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:30 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895" returned: 0 in 5.114s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:30 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b5cfc-b087-4da5-ab05-6882e98cf9b5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:31 devstack sudo[98879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a
Jul 19 19:55:31 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:31 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a" returned: 0 in 0.587s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:55:31 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Converted 1024.00 MB image at 200.21 MB/s
Jul 19 19:55:31 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895 is being set with open permissions: ugo+rw
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:31 devstack sudo[98884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895
Jul 19 19:55:31 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:31 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-741b1fa8-4e58-4515-8eaa-37815ac98895" released by "_copy_volume_from_snapshot" :: held 6.946s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-9affe7d0-59bc-4a02-afa7-a75d80515250-741b1fa8-4e58-4515-8eaa-37815ac98895" released by "_create_volume_from_snapshot" :: held 7.002s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.037s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.804s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Creating offline snapshot 9e7bba36-5192-4b73-881b-332f7614bb25 of volume 8f82a605-0b43-4b3a-9be5-6f69809a2ca4 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44c4cc5-e0f9-498a-8d02-04aed37a7e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741b1fa8-4e58-4515-8eaa-37815ac98895', 'volume_size': 1, 'snapshot_id': '9affe7d0-59bc-4a02-afa7-a75d80515250'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076c6d66-379a-4de2-9b6b-a9197d4dcef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f1ea20-f196-41d1-a4d1-840bf1977663]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:31 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Volume volume-741b1fa8-4e58-4515-8eaa-37815ac98895 (741b1fa8-4e58-4515-8eaa-37815ac98895): created successfully
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076c6d66-379a-4de2-9b6b-a9197d4dcef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Flow 'volume_create_manager' (73f26b3a-6fa2-48cc-9a91-ce9b943ec28c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-41681054-16e9-49e5-b8f8-216a5bba321e tempest-VolumeDependencyTests-1408449768 None] Created volume successfully.
Jul 19 19:55:32 devstack sudo[98893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4
Jul 19 19:55:32 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:32 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" returned: 0 in 0.389s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:32 devstack sudo[98898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 1G
Jul 19 19:55:32 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-9affe7d0-59bc-4a02-afa7-a75d80515250-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-9affe7d0-59bc-4a02-afa7-a75d80515250-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-quobyte-6e129d3d-7065-4547-9387-2e5726d8b26a" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-6e129d3d-7065-4547-9387-2e5726d8b26a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-quobyte-9affe7d0-59bc-4a02-afa7-a75d80515250" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-9affe7d0-59bc-4a02-afa7-a75d80515250" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Deleting offline snapshot 9affe7d0-59bc-4a02-afa7-a75d80515250 of volume 6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] snapshot_file for this snap is: volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0ded66-ee7b-467b-886d-edae7597dd15]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:32 devstack sudo[98903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250
Jul 19 19:55:32 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:32 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 1G" returned: 0 in 0.451s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:32 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25
Jul 19 19:55:32 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:32 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:32 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:33 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250" returned: 0 in 0.430s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e129d3d-7065-4547-9387-2e5726d8b26a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:55:33 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.292s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e067d2-85ef-42e3-88e7-793dd5f3a527]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:55:33 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25" returned: 0 in 0.366s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:33 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 is being set with open permissions: ugo+rw
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:33 devstack sudo[98918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25
Jul 19 19:55:33 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:33 devstack sudo[98917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a
Jul 19 19:55:33 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:33 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25" returned: 0 in 0.269s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:33 devstack sudo[98924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.info
Jul 19 19:55:33 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:33 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a" returned: 0 in 0.417s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:33 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250
Jul 19 19:55:33 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:33 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.info" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:33 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.info is being set with open permissions: ugo+rw
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:33 devstack sudo[98931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.info
Jul 19 19:55:33 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:33 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250" returned: 0 in 0.400s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:33 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250
Jul 19 19:55:33 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:33 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.info" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.538s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-537939501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2712eeee-3ca1-4f30-863f-438d98d3ff83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55977811b16847a3ab6f1140e9c0fd71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:28Z,use_quota=True,user_id='bc371e90970a4daeae532fde77215192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Creating volume 2712eeee-3ca1-4f30-863f-438d98d3ff83 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:34 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:34 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83 1073741824
Jul 19 19:55:34 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-96cd2103-a6ef-468a-a42b-b1ebba7bb61e tempest-SnapshotMetadataTestJSON-256972045 None] Create snapshot completed successfully
Jul 19 19:55:34 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a.9affe7d0-59bc-4a02-afa7-a75d80515250" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-9affe7d0-59bc-4a02-afa7-a75d80515250" released by "_delete_snapshot" :: held 1.658s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-6e129d3d-7065-4547-9387-2e5726d8b26a" released by "delete_snapshot" :: held 1.685s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Created reservations ['cf228093-b4cb-44e1-99fa-3dc0d7860582', '7d9309f5-3b3a-42f9-92c9-0ea498fa0596', 'b9ea26d9-3e25-4aa5-9e5f-4f4e6d7ccbc0', '0e7e6081-86fd-4111-9c04-7d490f19282e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Delete snapshot completed successfully.
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09ba0ca3-da87-4026-82a1-cc12bfeee05b tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-9affe7d0-59bc-4a02-afa7-a75d80515250-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9b38e47c-91c3-4dd5-83a8-36d493c68cf8 tempest-GroupsV314Test-1763123681 None] Group tempest-GroupsV314Test-Group-618808087: creating
Jul 19 19:55:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9b38e47c-91c3-4dd5-83a8-36d493c68cf8 tempest-GroupsV314Test-1763123681 None] Group tempest-GroupsV314Test-Group-618808087: created successfully
Jul 19 19:55:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9b38e47c-91c3-4dd5-83a8-36d493c68cf8 tempest-GroupsV314Test-1763123681 None] Create group completed successfully.
Jul 19 19:55:34 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83 1073741824" returned: 0 in 0.545s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:34 devstack sudo[98947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83
Jul 19 19:55:34 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-6e129d3d-7065-4547-9387-2e5726d8b26a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-6e129d3d-7065-4547-9387-2e5726d8b26a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-quobyte-6e129d3d-7065-4547-9387-2e5726d8b26a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-6e129d3d-7065-4547-9387-2e5726d8b26a" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8956cd67-6aff-48f7-b440-bc0fcb6a0d2d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:34 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83" returned: 0 in 0.310s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015bee63-1cf1-4311-b6c7-d5b43402a41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2712eeee-3ca1-4f30-863f-438d98d3ff83', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31660a25-1033-4ec5-8fec-d747fff5f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Volume volume-2712eeee-3ca1-4f30-863f-438d98d3ff83 (2712eeee-3ca1-4f30-863f-438d98d3ff83): created successfully
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31660a25-1033-4ec5-8fec-d747fff5f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Flow 'volume_create_manager' (d019ff44-7c32-435d-9dcb-98be815cf4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:34 devstack sudo[98949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a
Jul 19 19:55:34 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-eab85ea3-2727-438f-baf0-44679ea6f770 tempest-VolumesNegativeTest-1361199133 None] Created volume successfully.
Jul 19 19:55:35 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a" returned: 0 in 0.396s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:35 devstack sudo[98956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a
Jul 19 19:55:35 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "cinder-9e7bba36-5192-4b73-881b-332f7614bb25-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-9e7bba36-5192-4b73-881b-332f7614bb25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "cinder-quobyte-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-quobyte-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "cinder-quobyte-9e7bba36-5192-4b73-881b-332f7614bb25" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-quobyte-9e7bba36-5192-4b73-881b-332f7614bb25" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Deleting offline snapshot 9e7bba36-5192-4b73-881b-332f7614bb25 of volume 8f82a605-0b43-4b3a-9be5-6f69809a2ca4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] snapshot_file for this snap is: volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d82bac3-952f-4314-b9d7-31bb6e1fcebe]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:35 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6e129d3d-7065-4547-9387-2e5726d8b26a" returned: 0 in 0.302s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-6e129d3d-7065-4547-9387-2e5726d8b26a" released by "delete_volume" :: held 0.776s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:35 devstack sudo[98959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25
Jul 19 19:55:35 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Created reservations ['5b7de80d-27c8-4fda-97ff-30ef7dc66d2f', '44c2345e-750a-4a50-9b5b-3ae34717f4b4', 'a0d4972b-c680-4332-b904-2cd2764f6c2b', '37fdf74c-eb5f-43e5-bc90-c5bf149a079a'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:35 devstack sudo[98961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:35 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-741b1fa8-4e58-4515-8eaa-37815ac98895-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-741b1fa8-4e58-4515-8eaa-37815ac98895-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:36 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25" returned: 0 in 0.539s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "cinder-quobyte-741b1fa8-4e58-4515-8eaa-37815ac98895" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[020070fa-b81f-4cd1-abbc-def901e36946]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-741b1fa8-4e58-4515-8eaa-37815ac98895" acquired by "delete_volume" :: waited 0.041s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e50b6b5-beb8-4721-a4cc-88e146da4ff9]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:36 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.514s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Deleted volume successfully.
Jul 19 19:55:36 devstack sudo[98966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4
Jul 19 19:55:36 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-37064c9b-7c71-41fe-8945-b4de02dac6f0 tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-6e129d3d-7065-4547-9387-2e5726d8b26a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:36 devstack sudo[98968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895
Jul 19 19:55:36 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Flow 'volume_create_manager' (f6b81c44-2b85-42aa-9699-78cec6a2c47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5297cc-5275-4696-b41e-94b3466e8a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5297cc-5275-4696-b41e-94b3466e8a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-329956941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=58aab6b9-2996-4867-95f5-f52b90e30169,host='devstack@QuobyteHD#QuobyteHD',id=0ec10813-b711-4063-a02f-e52046ab6df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1046f5610f4cafa1b3ca43f7b8a8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:36Z,use_quota=True,user_id='44935763cb2044979447134206259898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af8dc8a2-ec27-4848-8b6b-50be3f5f0651),volume_type_id=af8dc8a2-ec27-4848-8b6b-50be3f5f0651)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf93c37-ecae-457b-b3d7-fa5494ce1443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf93c37-ecae-457b-b3d7-fa5494ce1443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f611b2d-b68f-4578-b6cb-b028470335de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f611b2d-b68f-4578-b6cb-b028470335de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec10813-b711-4063-a02f-e52046ab6df7', 'volume_name': 'volume-0ec10813-b711-4063-a02f-e52046ab6df7', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc74b74-c402-4483-91c1-3b45cd499ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc74b74-c402-4483-91c1-3b45cd499ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8c588d-b4f8-4442-bb3b-1da4884df894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:36 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Volume 0ec10813-b711-4063-a02f-e52046ab6df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec10813-b711-4063-a02f-e52046ab6df7', 'volume_size': 1}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=58aab6b9-2996-4867-95f5-f52b90e30169,created_at=2026-07-19T17:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-329956941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=58aab6b9-2996-4867-95f5-f52b90e30169,host='devstack@QuobyteHD#QuobyteHD',id=0ec10813-b711-4063-a02f-e52046ab6df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc1046f5610f4cafa1b3ca43f7b8a8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:36Z,use_quota=True,user_id='44935763cb2044979447134206259898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af8dc8a2-ec27-4848-8b6b-50be3f5f0651),volume_type_id=af8dc8a2-ec27-4848-8b6b-50be3f5f0651)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Creating volume 0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:36 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:36 devstack sudo[98974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 1073741824
Jul 19 19:55:36 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:36 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:36 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895" returned: 0 in 0.561s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" returned: 0 in 0.654s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:36 devstack sudo[98982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895
Jul 19 19:55:36 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:36 devstack sudo[98983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25
Jul 19 19:55:36 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:37 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-741b1fa8-4e58-4515-8eaa-37815ac98895" returned: 0 in 0.398s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-quobyte-741b1fa8-4e58-4515-8eaa-37815ac98895" released by "delete_volume" :: held 1.040s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:37 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 1073741824" returned: 0 in 0.607s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:37 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25" returned: 0 in 0.491s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Created reservations ['511a0bde-50c5-412c-8683-176fd14cd3f5', 'c59bce15-ece1-4256-89b5-45d9cb4c13c2', '04b1ce48-9add-41e1-b392-12c509e13a9a', 'fe1e2ffb-7f2d-4187-bd28-8fb26e282fd1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:37 devstack sudo[98995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25
Jul 19 19:55:37 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:37 devstack sudo[98997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7
Jul 19 19:55:37 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:37 devstack sudo[98999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:37 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:37 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4.9e7bba36-5192-4b73-881b-332f7614bb25" returned: 0 in 0.355s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:37 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-quobyte-9e7bba36-5192-4b73-881b-332f7614bb25" released by "_delete_snapshot" :: held 2.232s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:37 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7" returned: 0 in 0.387s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-quobyte-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" released by "delete_snapshot" :: held 2.275s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Deleted volume successfully.
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8c588d-b4f8-4442-bb3b-1da4884df894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec10813-b711-4063-a02f-e52046ab6df7', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4959015e-9cc4-4e50-9b53-d876c3cbf4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Volume volume-0ec10813-b711-4063-a02f-e52046ab6df7 (0ec10813-b711-4063-a02f-e52046ab6df7): created successfully
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4959015e-9cc4-4e50-9b53-d876c3cbf4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Flow 'volume_create_manager' (f6b81c44-2b85-42aa-9699-78cec6a2c47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-383124c6-6b87-4f79-b168-9b77c910ecfa tempest-GroupsV314Test-1763123681 None] Created volume successfully.
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d4a50506-4c86-4a1f-9c91-56f34dd5f1b1 tempest-VolumeDependencyTests-1408449768 None] Lock "cinder-741b1fa8-4e58-4515-8eaa-37815ac98895-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Created reservations ['19798f9d-5d40-4a30-ba6c-9a697a6c6059', 'bfabfbd0-cc5f-4f39-9eeb-107769b29bcc', '235efa43-60e9-4062-9292-f98a37dd92a1', 'ad016966-4ad3-4cf5-8fe3-57988f002936'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Delete snapshot completed successfully.
Jul 19 19:55:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-db3e00af-0eef-4193-b42e-db562e6d9ec5 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-9e7bba36-5192-4b73-881b-332f7614bb25-delete_snapshot" released by "delete_snapshot" :: held 2.625s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "cinder-8f82a605-0b43-4b3a-9be5-6f69809a2ca4-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-8f82a605-0b43-4b3a-9be5-6f69809a2ca4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "cinder-quobyte-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-quobyte-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[473a2e80-b88f-4cdc-9850-66b97b023929]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:39 devstack sudo[99020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4
Jul 19 19:55:39 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:39 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" returned: 0 in 0.542s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:39 devstack sudo[99025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4
Jul 19 19:55:39 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:39 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" returned: 0 in 0.358s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-quobyte-8f82a605-0b43-4b3a-9be5-6f69809a2ca4" released by "delete_volume" :: held 0.997s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:39 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Cloning volume 0ec10813-b711-4063-a02f-e52046ab6df7 to volume ad64ff78-364c-408e-8495-a0f9943c3192
Jul 19 19:55:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Creating offline snapshot 869887ab-db66-42f8-96c5-8baff8f196b9 of volume 0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Created reservations ['600d8e46-0569-4c00-ae57-ab2d5fd0dc1b', '83e094db-0bca-44ed-b290-68a8d1ddd28a', 'ebf90972-20fb-4290-a101-f55458d0d3fe', 'b272bde1-c57d-4ebd-b30c-f3e5814cedb5'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfb88f2-4e64-4816-ac16-4c4d3e8e50f6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:40 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7
Jul 19 19:55:40 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:40 devstack sudo[99030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:40 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:40 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7" returned: 0 in 0.556s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:40 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.404s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Deleted volume successfully.
Jul 19 19:55:40 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 1G
Jul 19 19:55:40 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-deffbcff-bc67-45b7-ab44-cb2d167e8ed0 tempest-SnapshotMetadataTestJSON-256972045 None] Lock "cinder-8f82a605-0b43-4b3a-9be5-6f69809a2ca4-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:41 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 1G" returned: 0 in 0.602s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec10813-b711-4063-a02f-e52046ab6df7 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:41 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec10813-b711-4063-a02f-e52046ab6df7 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9
Jul 19 19:55:41 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:41 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec10813-b711-4063-a02f-e52046ab6df7 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9" returned: 0 in 0.532s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:41 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:55:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:41 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9
Jul 19 19:55:41 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:42 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9" returned: 0 in 0.364s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:42 devstack sudo[99053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.info
Jul 19 19:55:42 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:42 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.info" returned: 0 in 0.509s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:42 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:55:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:42 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.info
Jul 19 19:55:42 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:43 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.info" returned: 0 in 0.566s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Acquiring lock "cinder-quobyte-ad64ff78-364c-408e-8495-a0f9943c3192" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Lock "cinder-quobyte-ad64ff78-364c-408e-8495-a0f9943c3192" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] snapshot: 869887ab-db66-42f8-96c5-8baff8f196b9, volume: ad64ff78-364c-408e-8495-a0f9943c3192,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2936fe72-ef10-4756-bb72-e6300c70aa34]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:43 devstack sudo[99122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9
Jul 19 19:55:43 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:44 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9" returned: 0 in 0.702s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec10813-b711-4063-a02f-e52046ab6df7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:55:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 19:55:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 19:55:44 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0539d3-4a89-4cb7-a463-8e6dfc831583]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:44 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7
Jul 19 19:55:44 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:44 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7" returned: 0 in 0.820s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:45 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192 not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 19:55:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:45 devstack sudo[99140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192
Jul 19 19:55:45 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:52 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=75,cinder:INSERT=22,cinder:UPDATE=95,cinder:DELETE=7 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:55:52 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=91,cinder:DELETE=8 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:55:52 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192" returned: 0 in 7.517s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:52 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7b831d-6d68-408e-b035-d3bfdd91bb0c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:52 devstack sudo[99178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7
Jul 19 19:55:52 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:53 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7" returned: 0 in 0.691s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:55:53 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Converted 1024.00 MB image at 136.21 MB/s
Jul 19 19:55:53 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192 is being set with open permissions: ugo+rw: NotImplementedError
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:53 devstack sudo[99183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192
Jul 19 19:55:53 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Flow 'volume_create_manager' (7f628d51-0238-4fdf-a814-4502b41dfaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3d498e-af30-4a18-8a0a-5a3fc622db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3d498e-af30-4a18-8a0a-5a3fc622db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-174954059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621e1485-e32a-4225-89af-77794250f82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afc1641164548f2a83821cfa48058da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:53Z,use_quota=True,user_id='4e75ca2a21ee49beaad73ba425318ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3411910d-f6cd-4bea-b22e-861d95f1a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3411910d-f6cd-4bea-b22e-861d95f1a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ec0b93-1558-4eaa-8b07-5e0e49609cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ec0b93-1558-4eaa-8b07-5e0e49609cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621e1485-e32a-4225-89af-77794250f82b', 'volume_name': 'volume-621e1485-e32a-4225-89af-77794250f82b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946fe3e1-cd18-4783-9c84-d61c9624bc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946fe3e1-cd18-4783-9c84-d61c9624bc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:53 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50090c0-2ca2-4c0b-ab11-cd2c69eaafea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:53 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Volume 621e1485-e32a-4225-89af-77794250f82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621e1485-e32a-4225-89af-77794250f82b', 'volume_size': 1}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192" returned: 0 in 0.325s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Lock "cinder-quobyte-ad64ff78-364c-408e-8495-a0f9943c3192" released by "_copy_volume_from_snapshot" :: held 10.227s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Acquiring lock "cinder-quobyte-869887ab-db66-42f8-96c5-8baff8f196b9" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Lock "cinder-quobyte-869887ab-db66-42f8-96c5-8baff8f196b9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Deleting offline snapshot 869887ab-db66-42f8-96c5-8baff8f196b9 of volume 0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] snapshot_file for this snap is: volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113d7df-c74d-4336-a280-1601ec152865]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:53 devstack sudo[99187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9
Jul 19 19:55:53 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:54 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9" returned: 0 in 0.376s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec10813-b711-4063-a02f-e52046ab6df7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:55:54 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69373bf-45f9-4ae5-84eb-ef67c582b5a3]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:54 devstack sudo[99192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7
Jul 19 19:55:54 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:54 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7" returned: 0 in 0.421s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:54 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9
Jul 19 19:55:54 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:54 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9" returned: 0 in 0.426s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:54 devstack sudo[99203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9
Jul 19 19:55:54 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:55 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7.869887ab-db66-42f8-96c5-8baff8f196b9" returned: 0 in 0.261s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Lock "cinder-quobyte-869887ab-db66-42f8-96c5-8baff8f196b9" released by "_delete_snapshot" :: held 1.583s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.296s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.648s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-174954059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621e1485-e32a-4225-89af-77794250f82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afc1641164548f2a83821cfa48058da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:55:53Z,use_quota=True,user_id='4e75ca2a21ee49beaad73ba425318ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Creating volume 621e1485-e32a-4225-89af-77794250f82b {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:55:55 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:55 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b 1073741824
Jul 19 19:55:55 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:55 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-16d1977d-bc63-46e0-ac00-224f38b9ae9e tempest-GroupsV314Test-1763123681 None] Create group from source-group-58aab6b9-2996-4867-95f5-f52b90e30169 completed successfully.
Jul 19 19:55:55 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b 1073741824" returned: 0 in 0.553s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:55 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b
Jul 19 19:55:55 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:56 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b" returned: 0 in 0.369s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50090c0-2ca2-4c0b-ab11-cd2c69eaafea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621e1485-e32a-4225-89af-77794250f82b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f473315f-1031-4ca6-8855-35759cfa8b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:55:56 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Volume volume-621e1485-e32a-4225-89af-77794250f82b (621e1485-e32a-4225-89af-77794250f82b): created successfully
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f473315f-1031-4ca6-8855-35759cfa8b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Flow 'volume_create_manager' (7f628d51-0238-4fdf-a814-4502b41dfaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:55:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1fe6e6cb-e1b8-42cc-9501-b8be05b365b3 tempest-VolumesTransfersV357Test-1027341324 None] Created volume successfully.
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Acquiring lock "cinder-quobyte-ad64ff78-364c-408e-8495-a0f9943c3192" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Lock "cinder-quobyte-ad64ff78-364c-408e-8495-a0f9943c3192" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8694dc15-1564-4ba0-be97-05bc2c035612]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:56 devstack sudo[99215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192
Jul 19 19:55:56 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:56 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192" returned: 0 in 0.439s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:56 devstack sudo[99221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192
Jul 19 19:55:56 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:57 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ad64ff78-364c-408e-8495-a0f9943c3192" returned: 0 in 0.299s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Lock "cinder-quobyte-ad64ff78-364c-408e-8495-a0f9943c3192" released by "delete_volume" :: held 0.814s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Created reservations ['432e4acc-11e0-4975-b8dd-bea860db7acb'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:57 devstack cinder-volume[87353]: WARNING cinder.quota [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1722421362 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1722421362, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:55:57 devstack cinder-volume[87353]: WARNING cinder.quota [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1722421362 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1722421362, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Created reservations ['9bbf8435-f44f-4fc2-b298-c4045e49763b', '5a60d118-bcf9-4afd-b7db-5d7f213909de', '6c296e23-1c2d-4297-b2a8-caa1ca639109', '265e7588-ace3-4775-8855-3e5802249954'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:57 devstack sudo[99224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:57 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2583cb5f-f109-428b-b949-f857871920e9 tempest-VolumesTransfersV357Test-490610682 None] Transfer volume completed successfully.
Jul 19 19:55:57 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.331s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5faf07b6-ed4f-49f1-af1b-3348fe3d04dc tempest-GroupsV314Test-1763123681 None] Delete group completed successfully.
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Acquiring lock "cinder-quobyte-0ec10813-b711-4063-a02f-e52046ab6df7" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Lock "cinder-quobyte-0ec10813-b711-4063-a02f-e52046ab6df7" acquired by "delete_volume" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[07472f2e-88ef-4bbd-b4cc-dbfa0abee51a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:58 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7
Jul 19 19:55:58 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:58 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7" returned: 0 in 0.509s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:58 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7
Jul 19 19:55:58 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Acquiring lock "cinder-621e1485-e32a-4225-89af-77794250f82b-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Lock "cinder-621e1485-e32a-4225-89af-77794250f82b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Acquiring lock "cinder-quobyte-621e1485-e32a-4225-89af-77794250f82b" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Lock "cinder-quobyte-621e1485-e32a-4225-89af-77794250f82b" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14959c4-8aed-4054-90c8-3fbbc4a30087]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:58 devstack sudo[99234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b
Jul 19 19:55:58 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:58 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0ec10813-b711-4063-a02f-e52046ab6df7" returned: 0 in 0.383s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Lock "cinder-quobyte-0ec10813-b711-4063-a02f-e52046ab6df7" released by "delete_volume" :: held 0.982s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Created reservations ['4bdf7620-a097-49e6-b2b7-894e094ce967'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Created reservations ['ade5de92-9625-4483-b357-74742764ec86', 'fd65cb32-a858-42e5-8095-607b1866b39a', '2fdd9634-c2fd-48f4-94b1-eccba149c933', '03854cc9-7bc6-4416-b87e-5e73e3c8756a'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:59 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b" returned: 0 in 0.502s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:59 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b
Jul 19 19:55:59 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:59 devstack sudo[99241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:59 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:55:59 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.336s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:55:59 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Jul 19 19:55:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8bfa284f-93cb-4b35-954f-9bf313f67530 tempest-GroupsV314Test-1763123681 None] Delete group completed successfully.
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-621e1485-e32a-4225-89af-77794250f82b" returned: 0 in 0.390s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Lock "cinder-quobyte-621e1485-e32a-4225-89af-77794250f82b" released by "delete_volume" :: held 0.940s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Created reservations ['d0217374-2318-4029-b608-2be4859724e0', '5791582b-562e-4812-9ec6-90c101858f62', '4e81ddeb-4c6d-45fc-940d-f8960f7c2b2b', '999cf00e-e52e-4929-95be-16bd92999067'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:55:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:55:59 devstack sudo[99246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:55:59 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:00 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.285s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:00 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Deleted volume successfully.
Jul 19 19:56:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d38a3f78-3329-4bb5-8073-dda66c790e08 tempest-VolumesTransfersV357Test-618303739 None] Lock "cinder-621e1485-e32a-4225-89af-77794250f82b-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Flow 'volume_create_manager' (b6fb01f5-6be1-48d7-90f7-8bd9815102f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50abe7bf-e23f-470d-82b9-75fdf5d7e028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50abe7bf-e23f-470d-82b9-75fdf5d7e028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2104540397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f99ac8-c1a5-4582-b961-32c963144d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afc1641164548f2a83821cfa48058da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:01Z,use_quota=True,user_id='4e75ca2a21ee49beaad73ba425318ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b834923-11de-4e5c-a6e2-4c17a7c95f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b834923-11de-4e5c-a6e2-4c17a7c95f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14507b7c-228f-4839-939f-eedd920ea72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14507b7c-228f-4839-939f-eedd920ea72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f99ac8-c1a5-4582-b961-32c963144d9d', 'volume_name': 'volume-e1f99ac8-c1a5-4582-b961-32c963144d9d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0e39bc-5a0d-4f65-acc2-382eeadf9430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0e39bc-5a0d-4f65-acc2-382eeadf9430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf37fc74-d712-4fdd-b160-a1821e393c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:01 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Volume e1f99ac8-c1a5-4582-b961-32c963144d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f99ac8-c1a5-4582-b961-32c963144d9d', 'volume_size': 1}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2104540397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f99ac8-c1a5-4582-b961-32c963144d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afc1641164548f2a83821cfa48058da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:01Z,use_quota=True,user_id='4e75ca2a21ee49beaad73ba425318ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Creating volume e1f99ac8-c1a5-4582-b961-32c963144d9d {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:01 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:01 devstack sudo[99249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d 1073741824
Jul 19 19:56:01 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Acquiring lock "cinder-2712eeee-3ca1-4f30-863f-438d98d3ff83-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Lock "cinder-2712eeee-3ca1-4f30-863f-438d98d3ff83-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Acquiring lock "cinder-quobyte-2712eeee-3ca1-4f30-863f-438d98d3ff83" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Lock "cinder-quobyte-2712eeee-3ca1-4f30-863f-438d98d3ff83" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c511b2fd-971d-42a0-a42a-cdc20eac0238]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:02 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d 1073741824" returned: 0 in 0.578s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:02 devstack sudo[99256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d
Jul 19 19:56:02 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:02 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83
Jul 19 19:56:02 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:02 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d" returned: 0 in 0.280s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf37fc74-d712-4fdd-b160-a1821e393c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f99ac8-c1a5-4582-b961-32c963144d9d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc91b3d-a0e5-4e0c-b595-31027ee10a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Volume volume-e1f99ac8-c1a5-4582-b961-32c963144d9d (e1f99ac8-c1a5-4582-b961-32c963144d9d): created successfully
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc91b3d-a0e5-4e0c-b595-31027ee10a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Flow 'volume_create_manager' (b6fb01f5-6be1-48d7-90f7-8bd9815102f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ff1ed82c-3849-46e5-94f1-871f33e9a889 tempest-VolumesTransfersV357Test-1027341324 None] Created volume successfully.
Jul 19 19:56:02 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83" returned: 0 in 0.442s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:02 devstack sudo[99263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83
Jul 19 19:56:02 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:02 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2712eeee-3ca1-4f30-863f-438d98d3ff83" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Lock "cinder-quobyte-2712eeee-3ca1-4f30-863f-438d98d3ff83" released by "delete_volume" :: held 0.744s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:02 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Created reservations ['3b671e1a-bc10-4501-9a7d-b8f531f57206', '777b8f80-bc47-4736-ac7e-05e4f83dfa23', 'cb3b9291-d677-4774-91b7-d11f6ca7d165', 'd71ca7d5-bf8b-4a3e-b8ff-41a1e1fb0591'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:03 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:03 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:03 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.284s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Deleted volume successfully.
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6186fbd8-8d37-44fd-8aee-d3e5ec6b7613 tempest-VolumesNegativeTest-1361199133 None] Lock "cinder-2712eeee-3ca1-4f30-863f-438d98d3ff83-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Acquiring lock "cinder-e1f99ac8-c1a5-4582-b961-32c963144d9d-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Lock "cinder-e1f99ac8-c1a5-4582-b961-32c963144d9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Acquiring lock "cinder-quobyte-e1f99ac8-c1a5-4582-b961-32c963144d9d" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Lock "cinder-quobyte-e1f99ac8-c1a5-4582-b961-32c963144d9d" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f9e393-cec1-498b-be6b-cee50cbab621]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:04 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d
Jul 19 19:56:04 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:04 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d" returned: 0 in 0.439s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:04 devstack sudo[99275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d
Jul 19 19:56:04 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:04 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1f99ac8-c1a5-4582-b961-32c963144d9d" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Lock "cinder-quobyte-e1f99ac8-c1a5-4582-b961-32c963144d9d" released by "delete_volume" :: held 0.781s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Created reservations ['b9fb8667-d280-459c-8933-41d9cb681807', 'c032e48a-a622-45bd-b97a-bd504f17ec08', '6f27468f-1776-4a15-93d0-4d0a5362ea73', '33558d1d-ac3e-4c05-b30d-2a36170c9577'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:04 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:04 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:05 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.299s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:05 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:05 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Deleted volume successfully.
Jul 19 19:56:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6ee0b371-21a5-43f4-a7a2-32fe1950f39f tempest-VolumesTransfersV357Test-618303739 None] Lock "cinder-e1f99ac8-c1a5-4582-b961-32c963144d9d-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (bd9e430c-333a-429f-b933-015aebae1845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b32b940-8beb-4293-91fb-21b150ac138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b32b940-8beb-4293-91fb-21b150ac138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-388957588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fdc95c-c509-444d-b0a3-95b3798adff4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:12Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f17efa7-7855-4b27-8370-26d23b9a5162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f17efa7-7855-4b27-8370-26d23b9a5162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af54ae5-3992-447d-860f-dd9e311d1cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af54ae5-3992-447d-860f-dd9e311d1cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7fdc95c-c509-444d-b0a3-95b3798adff4', 'volume_name': 'volume-a7fdc95c-c509-444d-b0a3-95b3798adff4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f3815a-3011-4af0-b7c4-9c1da72004a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f3815a-3011-4af0-b7c4-9c1da72004a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501261a1-6b38-46ac-8feb-9d58ffbbb766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:11 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Volume a7fdc95c-c509-444d-b0a3-95b3798adff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7fdc95c-c509-444d-b0a3-95b3798adff4', 'volume_size': 1}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-388957588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7fdc95c-c509-444d-b0a3-95b3798adff4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:12Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Creating volume a7fdc95c-c509-444d-b0a3-95b3798adff4 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:11 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:11 devstack sudo[99283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4 1073741824
Jul 19 19:56:11 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:12 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4 1073741824" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:12 devstack sudo[99288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4
Jul 19 19:56:12 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:12 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4" returned: 0 in 0.348s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501261a1-6b38-46ac-8feb-9d58ffbbb766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7fdc95c-c509-444d-b0a3-95b3798adff4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7863938b-def1-4a49-94c6-2affd9a72683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:12 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Volume volume-a7fdc95c-c509-444d-b0a3-95b3798adff4 (a7fdc95c-c509-444d-b0a3-95b3798adff4): created successfully
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7863938b-def1-4a49-94c6-2affd9a72683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (bd9e430c-333a-429f-b933-015aebae1845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:12 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-fc713524-9a11-4f92-93fb-cd14d7df1dab tempest-VolumesGetTest-656397604 None] Created volume successfully.
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (8a6f573c-15d8-48fd-8e7b-d9fdf7c60804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e22ccd-ec32-4003-a5f2-f2d94f98c6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e22ccd-ec32-4003-a5f2-f2d94f98c6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1909996552',display_name='tempest-VolumesGetTest-Volume-1775244360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb23439-69b7-4af9-8215-b8b9fa18f578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:15Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9de4bb-17bb-4d60-a3bb-47072947fc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9de4bb-17bb-4d60-a3bb-47072947fc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32033d9-2367-46a1-a72b-f118bbbdd331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32033d9-2367-46a1-a72b-f118bbbdd331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb23439-69b7-4af9-8215-b8b9fa18f578', 'volume_name': 'volume-ceb23439-69b7-4af9-8215-b8b9fa18f578', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0aa7578-52f7-4ef1-892b-fe9549720cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0aa7578-52f7-4ef1-892b-fe9549720cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffd08ce-29aa-41b4-a241-51346ae2d8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:14 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Volume ceb23439-69b7-4af9-8215-b8b9fa18f578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb23439-69b7-4af9-8215-b8b9fa18f578', 'volume_size': 1}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1909996552',display_name='tempest-VolumesGetTest-Volume-1775244360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb23439-69b7-4af9-8215-b8b9fa18f578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:15Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Creating volume ceb23439-69b7-4af9-8215-b8b9fa18f578 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:14 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:14 devstack sudo[99292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578 1073741824
Jul 19 19:56:14 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:15 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578 1073741824" returned: 0 in 0.547s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:15 devstack sudo[99298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578
Jul 19 19:56:15 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:15 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578" returned: 0 in 0.340s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffd08ce-29aa-41b4-a241-51346ae2d8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb23439-69b7-4af9-8215-b8b9fa18f578', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15719316-67f8-41a3-a2d9-834758ee233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:15 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Volume volume-ceb23439-69b7-4af9-8215-b8b9fa18f578 (ceb23439-69b7-4af9-8215-b8b9fa18f578): created successfully
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15719316-67f8-41a3-a2d9-834758ee233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (8a6f573c-15d8-48fd-8e7b-d9fdf7c60804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b1a4af72-1e8a-4228-b8ff-36ee587411b3 tempest-VolumesGetTest-656397604 None] Created volume successfully.
Jul 19 19:56:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-ceb23439-69b7-4af9-8215-b8b9fa18f578-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Lock "cinder-ceb23439-69b7-4af9-8215-b8b9fa18f578-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-ceb23439-69b7-4af9-8215-b8b9fa18f578" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-ceb23439-69b7-4af9-8215-b8b9fa18f578" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bf9314-3567-43c5-9fc0-0786b66ff807]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:17 devstack sudo[99301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578
Jul 19 19:56:17 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:17 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578" returned: 0 in 0.440s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:17 devstack sudo[99306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578
Jul 19 19:56:17 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:17 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ceb23439-69b7-4af9-8215-b8b9fa18f578" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-ceb23439-69b7-4af9-8215-b8b9fa18f578" released by "delete_volume" :: held 0.806s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Created reservations ['3cf523d3-34bc-47f4-8444-e1538ac42b68', 'e52b519a-d990-4e04-be59-d0d204aafcff', '54c8da05-82bf-45ab-af34-83b789c9d472', '53edf1d8-9d82-4268-a5b8-a1c52cf505d9'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:17 devstack sudo[99309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:17 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-a7fdc95c-c509-444d-b0a3-95b3798adff4-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Lock "cinder-a7fdc95c-c509-444d-b0a3-95b3798adff4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:18 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-a7fdc95c-c509-444d-b0a3-95b3798adff4" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.373s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:18 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Deleted volume successfully.
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-a7fdc95c-c509-444d-b0a3-95b3798adff4" acquired by "delete_volume" :: waited 0.046s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4ac3a89d-ef0c-4146-9ea9-c98616b0da94 tempest-VolumesGetTest-656397604 None] Lock "cinder-ceb23439-69b7-4af9-8215-b8b9fa18f578-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b56bf-9d2d-45e5-bdc1-974848774f85]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:18 devstack sudo[99312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4
Jul 19 19:56:18 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:18 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4" returned: 0 in 0.432s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:18 devstack sudo[99317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4
Jul 19 19:56:18 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:19 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a7fdc95c-c509-444d-b0a3-95b3798adff4" returned: 0 in 0.284s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-a7fdc95c-c509-444d-b0a3-95b3798adff4" released by "delete_volume" :: held 0.784s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Created reservations ['1c0962f4-f688-4a11-b146-170de9acc7ac', '186efa78-2290-49b4-b7db-684cd6677c08', '7b320c22-d8a8-487c-bdd0-08a547c85424', '6ba68e2a-05c0-4eca-8756-bf1bb55e4cb8'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:19 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:19 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:19 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.295s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Deleted volume successfully.
Jul 19 19:56:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ac2eebeb-7aec-4d9a-a6c6-b4c82576546d tempest-VolumesGetTest-656397604 None] Lock "cinder-a7fdc95c-c509-444d-b0a3-95b3798adff4-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (b9b1ad4a-c966-46fa-869f-e92cb8e95806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4758d74-b20a-49ea-bd93-b6c14c328cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4758d74-b20a-49ea-bd93-b6c14c328cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-981000978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:20Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3c29f9-073c-4e86-8ef4-87e6bbe6dddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3c29f9-073c-4e86-8ef4-87e6bbe6dddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a672c730-5526-4593-9e6b-19e92ac45f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a672c730-5526-4593-9e6b-19e92ac45f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb', 'volume_name': 'volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549e2f79-e881-434e-bffc-767c3deb3f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549e2f79-e881-434e-bffc-767c3deb3f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d21d578-0055-4955-ae37-727fcd04c608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:20 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Volume f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb', 'volume_size': 1}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-981000978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:20Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Creating volume f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:20 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:20 devstack sudo[99359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb 1073741824
Jul 19 19:56:20 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:20 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb 1073741824" returned: 0 in 0.482s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:20 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb
Jul 19 19:56:20 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:21 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d21d578-0055-4955-ae37-727fcd04c608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d75e141-8264-42a4-8b2b-e0ca3ca4ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:21 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Volume volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb (f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb): created successfully
Jul 19 19:56:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d75e141-8264-42a4-8b2b-e0ca3ca4ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (b9b1ad4a-c966-46fa-869f-e92cb8e95806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:21 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-46529cc7-b88f-44e0-8a61-f8455a04b06b tempest-VolumesGetTest-656397604 None] Created volume successfully.
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (41df0b39-cb3b-4c16-9439-4bd985ce7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e790b839-cd96-4b64-8394-e071624be5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e790b839-cd96-4b64-8394-e071624be5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1947929320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e2c00c-5767-41ee-9233-c2c3e946d3f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:23Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01c82b9-7f2a-44de-8499-216d53a8e204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01c82b9-7f2a-44de-8499-216d53a8e204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5e6fdf-d4b8-45ca-bda5-be6b53d09ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5e6fdf-d4b8-45ca-bda5-be6b53d09ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '73e2c00c-5767-41ee-9233-c2c3e946d3f0', 'volume_name': 'volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0', 'volume_size': 1, 'source_volid': 'f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb', 'source_volstatus': 'available'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea37b9ff-aba7-42c9-912d-81f007816160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea37b9ff-aba7-42c9-912d-81f007816160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d545fb8-7635-4e71-9cf0-e291d7dc31ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:23 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Volume 73e2c00c-5767-41ee-9233-c2c3e946d3f0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0', 'volume_size': 1, 'source_volid': 'f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb', 'source_volstatus': 'available'}
Jul 19 19:56:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:23 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Cloning volume f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb to volume 73e2c00c-5767-41ee-9233-c2c3e946d3f0
Jul 19 19:56:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Creating offline snapshot 29da2426-2e6a-4ecd-b780-434f557e0a92 of volume f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:56:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb5aee6-9baf-4913-b164-88878342348b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:23 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb
Jul 19 19:56:23 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:23 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" returned: 0 in 0.449s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:23 devstack sudo[99374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 1G
Jul 19 19:56:23 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:24 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 1G" returned: 0 in 0.552s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:24 devstack sudo[99381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92
Jul 19 19:56:24 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:24 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92" returned: 0 in 0.445s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:24 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 is being set with open permissions: ugo+rw
Jul 19 19:56:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:24 devstack sudo[99387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92
Jul 19 19:56:24 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:24 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92" returned: 0 in 0.327s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:24 devstack sudo[99390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.info
Jul 19 19:56:24 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Flow 'volume_create_manager' (2a851975-5fde-49a3-9eaf-e1cc58978867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4509255c-4fcc-4174-a48a-fed53235e07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4509255c-4fcc-4174-a48a-fed53235e07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1933219585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddd173a-da87-4019-83b1-98be362c6c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507b47f991994d3b86ea6cddbe73fc64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:25Z,use_quota=True,user_id='6b295e4fd8714331b0fcebcb987eaf25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a01390-338a-4fa4-b8ad-79a43bc02052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a01390-338a-4fa4-b8ad-79a43bc02052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956d6ecc-6010-4051-a517-a6a934095440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956d6ecc-6010-4051-a517-a6a934095440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddd173a-da87-4019-83b1-98be362c6c88', 'volume_name': 'volume-bddd173a-da87-4019-83b1-98be362c6c88', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:25 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d10891-77b3-4fb4-bf46-c3c704f50262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d10891-77b3-4fb4-bf46-c3c704f50262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95337f3-1e26-4859-a657-521854ca3f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:25 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Volume bddd173a-da87-4019-83b1-98be362c6c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddd173a-da87-4019-83b1-98be362c6c88', 'volume_size': 1}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.info" returned: 0 in 0.318s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:25 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.info is being set with open permissions: ugo+rw
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:25 devstack sudo[99393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.info
Jul 19 19:56:25 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:25 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.info" returned: 0 in 0.269s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-73e2c00c-5767-41ee-9233-c2c3e946d3f0" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-73e2c00c-5767-41ee-9233-c2c3e946d3f0" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] snapshot: 29da2426-2e6a-4ecd-b780-434f557e0a92, volume: 73e2c00c-5767-41ee-9233-c2c3e946d3f0,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8338a0-32fb-401b-a3fe-351e4f139e8f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:25 devstack sudo[99396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92
Jul 19 19:56:25 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:25 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92" returned: 0 in 0.375s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec267c8-7170-405e-8b21-97db87b0db97]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:26 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb
Jul 19 19:56:26 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:26 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" returned: 0 in 0.374s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:26 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0 not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 19:56:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:26 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0
Jul 19 19:56:26 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:31 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0" returned: 0 in 4.853s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:31 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[46069992-7bbb-49ed-aaad-8d868747f952]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:31 devstack sudo[99420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb
Jul 19 19:56:31 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:31 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" returned: 0 in 0.568s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:31 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:56:31 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Converted 1024.00 MB image at 210.93 MB/s
Jul 19 19:56:31 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0 is being set with open permissions: ugo+rw
Jul 19 19:56:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:31 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0
Jul 19 19:56:31 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:32 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0" returned: 0 in 0.245s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-73e2c00c-5767-41ee-9233-c2c3e946d3f0" released by "_copy_volume_from_snapshot" :: held 6.513s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-29da2426-2e6a-4ecd-b780-434f557e0a92" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-29da2426-2e6a-4ecd-b780-434f557e0a92" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Deleting offline snapshot 29da2426-2e6a-4ecd-b780-434f557e0a92 of volume f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] snapshot_file for this snap is: volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cc20f3-0970-419e-a633-efd6dcb67ce4]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:32 devstack sudo[99434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92
Jul 19 19:56:32 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:32 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92" returned: 0 in 0.373s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a0d31f-b44a-40cd-97c2-e6c0ca70da6d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:32 devstack sudo[99439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb
Jul 19 19:56:32 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:32 devstack sudo[99441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:32 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:32 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" returned: 0 in 0.403s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:32 devstack sudo[99446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92
Jul 19 19:56:32 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:33 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.294s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:56:33 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92" returned: 0 in 0.380s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:33 devstack sudo[99453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92
Jul 19 19:56:33 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Flow 'volume_create_manager' (9718f556-c7ff-419b-a395-9eb87ea838c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92da4c02-1f6e-403e-9da7-948e6cc3231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92da4c02-1f6e-403e-9da7-948e6cc3231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1922854942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84117ab5-f514-4f61-9eff-05e7e1386dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2844b2c5a4dd4be1ac1e9896b884ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:33Z,use_quota=True,user_id='bf14374a8cae46e1bcfe899cc6a07426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86f2927a-8f56-4f06-a8c9-22d4bab39677),volume_type_id=86f2927a-8f56-4f06-a8c9-22d4bab39677)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25df5ac-f93e-4dd4-a6fd-5f9c6cc9f628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25df5ac-f93e-4dd4-a6fd-5f9c6cc9f628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f085f2-9355-48f0-ac20-81f838e08644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f085f2-9355-48f0-ac20-81f838e08644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84117ab5-f514-4f61-9eff-05e7e1386dc8', 'volume_name': 'volume-84117ab5-f514-4f61-9eff-05e7e1386dc8', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fe338d-2101-42af-bf83-f2011f9f4899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fe338d-2101-42af-bf83-f2011f9f4899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d0e86c-e35e-4863-b029-77f1cad66bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Volume 84117ab5-f514-4f61-9eff-05e7e1386dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84117ab5-f514-4f61-9eff-05e7e1386dc8', 'volume_size': 1}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:33 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb.29da2426-2e6a-4ecd-b780-434f557e0a92" returned: 0 in 0.273s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-29da2426-2e6a-4ecd-b780-434f557e0a92" released by "_delete_snapshot" :: held 1.538s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.649s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.436s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1933219585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddd173a-da87-4019-83b1-98be362c6c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507b47f991994d3b86ea6cddbe73fc64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:25Z,use_quota=True,user_id='6b295e4fd8714331b0fcebcb987eaf25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Creating volume bddd173a-da87-4019-83b1-98be362c6c88 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:33 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:33 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88 1073741824
Jul 19 19:56:33 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d545fb8-7635-4e71-9cf0-e291d7dc31ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0', 'volume_size': 1, 'source_volid': 'f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb', 'source_volstatus': 'available'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5517938-4be9-415c-a63e-0fcd47a52211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Volume volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0 (73e2c00c-5767-41ee-9233-c2c3e946d3f0): created successfully
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5517938-4be9-415c-a63e-0fcd47a52211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (41df0b39-cb3b-4c16-9439-4bd985ce7b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Flow 'volume_create_manager' (5e4193bd-14fe-4353-b7e2-dcdecf4d6806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e165cb62-7023-4998-952f-5bb55c56b4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-65989064-5fa0-412a-b580-485915380e19 tempest-VolumesGetTest-656397604 None] Created volume successfully.
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e165cb62-7023-4998-952f-5bb55c56b4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1568434520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41bd5a52-24b9-4795-821d-1d2565184bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2844b2c5a4dd4be1ac1e9896b884ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:34Z,use_quota=True,user_id='bf14374a8cae46e1bcfe899cc6a07426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2189a3f0-c7ca-4ed7-919d-88625424efa1),volume_type_id=2189a3f0-c7ca-4ed7-919d-88625424efa1)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c12e10-9fb5-4370-8af5-d23f7ca2377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c12e10-9fb5-4370-8af5-d23f7ca2377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624884eb-9d28-4873-9753-ee020f3d5e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624884eb-9d28-4873-9753-ee020f3d5e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41bd5a52-24b9-4795-821d-1d2565184bc5', 'volume_name': 'volume-41bd5a52-24b9-4795-821d-1d2565184bc5', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173a352c-a344-41b0-a0f7-a274e78b3100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173a352c-a344-41b0-a0f7-a274e78b3100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f53158d-6723-49eb-97aa-0bcd46f3c571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Volume 41bd5a52-24b9-4795-821d-1d2565184bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41bd5a52-24b9-4795-821d-1d2565184bc5', 'volume_size': 1}
Jul 19 19:56:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:34 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88 1073741824" returned: 0 in 0.509s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:34 devstack sudo[99463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88
Jul 19 19:56:34 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Flow 'volume_create_manager' (badc11a5-337d-47cf-b6c5-314406d5bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bedd0c-0933-48ef-a852-80d71efc8d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bedd0c-0933-48ef-a852-80d71efc8d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1701672347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63340f06-b17c-4d27-8bff-207dec1721f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2844b2c5a4dd4be1ac1e9896b884ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:34Z,use_quota=True,user_id='bf14374a8cae46e1bcfe899cc6a07426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03654b97-496b-49bb-923e-e794cdbd3df0),volume_type_id=03654b97-496b-49bb-923e-e794cdbd3df0)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5ed818-ed50-44e1-b750-7bf2ddd81289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5ed818-ed50-44e1-b750-7bf2ddd81289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9fcaa1-d49c-4370-bf4d-52bf43732373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 19:56:34 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1922854942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84117ab5-f514-4f61-9eff-05e7e1386dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2844b2c5a4dd4be1ac1e9896b884ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:33Z,use_quota=True,user_id='bf14374a8cae46e1bcfe899cc6a07426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86f2927a-8f56-4f06-a8c9-22d4bab39677),volume_type_id=86f2927a-8f56-4f06-a8c9-22d4bab39677)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Creating volume 84117ab5-f514-4f61-9eff-05e7e1386dc8 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:34 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:34 devstack sudo[99466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8 1073741824
Jul 19 19:56:34 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95337f3-1e26-4859-a657-521854ca3f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddd173a-da87-4019-83b1-98be362c6c88', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80cd3e2-4b93-45d1-a2d4-e390f1e5d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Volume volume-bddd173a-da87-4019-83b1-98be362c6c88 (bddd173a-da87-4019-83b1-98be362c6c88): created successfully
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80cd3e2-4b93-45d1-a2d4-e390f1e5d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Flow 'volume_create_manager' (2a851975-5fde-49a3-9eaf-e1cc58978867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b3da86ba-2ee5-4bf2-84df-ba75df692fb3 tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Created volume successfully.
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9fcaa1-d49c-4370-bf4d-52bf43732373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63340f06-b17c-4d27-8bff-207dec1721f3', 'volume_name': 'volume-63340f06-b17c-4d27-8bff-207dec1721f3', 'volume_size': 1, 'image_id': '5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--251932364', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2844b2c5a4dd4be1ac1e9896b884ac3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'created_at': datetime.datetime(2026, 7, 19, 17, 56, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 56, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb0410>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ca5eca-8485-43b4-b589-24759d91c356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ca5eca-8485-43b4-b589-24759d91c356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1d56b1-f1dd-4c3f-9ffb-8844f3ceb263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Volume 63340f06-b17c-4d27-8bff-207dec1721f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63340f06-b17c-4d27-8bff-207dec1721f3', 'volume_size': 1, 'image_id': '5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--251932364', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2844b2c5a4dd4be1ac1e9896b884ac3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'created_at': datetime.datetime(2026, 7, 19, 17, 56, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 56, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb0410>}
Jul 19 19:56:34 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Trying to clone 63340f06-b17c-4d27-8bff-207dec1721f3 from image 5a628cc4-6b93-4edb-97bc-83b2dcf8a007 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 19:56:35 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8 1073741824" returned: 0 in 0.517s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:35 devstack sudo[99472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8
Jul 19 19:56:35 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8" returned: 0 in 0.320s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:35 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1568434520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41bd5a52-24b9-4795-821d-1d2565184bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2844b2c5a4dd4be1ac1e9896b884ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:34Z,use_quota=True,user_id='bf14374a8cae46e1bcfe899cc6a07426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2189a3f0-c7ca-4ed7-919d-88625424efa1),volume_type_id=2189a3f0-c7ca-4ed7-919d-88625424efa1)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Creating volume 41bd5a52-24b9-4795-821d-1d2565184bc5 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:35 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d0e86c-e35e-4863-b029-77f1cad66bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84117ab5-f514-4f61-9eff-05e7e1386dc8', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:35 devstack sudo[99475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5 1073741824
Jul 19 19:56:35 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59b5f7b-645b-4624-9e4c-8c2f1d5eb8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:35 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Volume volume-84117ab5-f514-4f61-9eff-05e7e1386dc8 (84117ab5-f514-4f61-9eff-05e7e1386dc8): created successfully
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59b5f7b-645b-4624-9e4c-8c2f1d5eb8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Flow 'volume_create_manager' (9718f556-c7ff-419b-a395-9eb87ea838c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f6a96323-9870-461e-8b15-fc01deddea49 tempest-TestInstancesWithCinderVolumes-290215021 None] Created volume successfully.
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (9296de7d-cab9-46fb-bccd-20df06a1238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9526974-7a63-44fb-9468-f5587cefe986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9526974-7a63-44fb-9468-f5587cefe986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-377204654',display_name='tempest-VolumesGetTest-Volume-1936956333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15701357-0317-44b9-ab82-47bc564c1e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:36Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de1cfcb-5a3b-454a-b632-811885e4169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de1cfcb-5a3b-454a-b632-811885e4169d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f0834c-0850-4e95-b7d9-b9b4f44aa8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f0834c-0850-4e95-b7d9-b9b4f44aa8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15701357-0317-44b9-ab82-47bc564c1e8b', 'volume_name': 'volume-15701357-0317-44b9-ab82-47bc564c1e8b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f96cc4-a6ae-45ef-bcbe-4e6596044fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f96cc4-a6ae-45ef-bcbe-4e6596044fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c889eb-7982-46e4-836c-a59d80899847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:35 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Volume 15701357-0317-44b9-ab82-47bc564c1e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15701357-0317-44b9-ab82-47bc564c1e8b', 'volume_size': 1}
Jul 19 19:56:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:36 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5 1073741824" returned: 0 in 0.598s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:36 devstack sudo[99481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5
Jul 19 19:56:36 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Acquiring lock "cinder-bddd173a-da87-4019-83b1-98be362c6c88-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "cinder-bddd173a-da87-4019-83b1-98be362c6c88-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Acquiring lock "cinder-quobyte-bddd173a-da87-4019-83b1-98be362c6c88" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "cinder-quobyte-bddd173a-da87-4019-83b1-98be362c6c88" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:36 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[1125dedb-762f-4298-be03-d7102d4d68a8]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-377204654',display_name='tempest-VolumesGetTest-Volume-1936956333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15701357-0317-44b9-ab82-47bc564c1e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:36Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Creating volume 15701357-0317-44b9-ab82-47bc564c1e8b {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:36 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:36 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b 1073741824
Jul 19 19:56:36 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f53158d-6723-49eb-97aa-0bcd46f3c571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41bd5a52-24b9-4795-821d-1d2565184bc5', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c501e8a0-2dcd-4076-941a-fc0e84b96452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:36 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Volume volume-41bd5a52-24b9-4795-821d-1d2565184bc5 (41bd5a52-24b9-4795-821d-1d2565184bc5): created successfully
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c501e8a0-2dcd-4076-941a-fc0e84b96452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Flow 'volume_create_manager' (5e4193bd-14fe-4353-b7e2-dcdecf4d6806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-74062b37-c50c-4025-b745-01f63f0a5085 tempest-TestInstancesWithCinderVolumes-290215021 None] Created volume successfully.
Jul 19 19:56:36 devstack sudo[99485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88
Jul 19 19:56:36 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:36 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88" returned: 0 in 0.397s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:36 devstack sudo[99495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88
Jul 19 19:56:36 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:36 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b 1073741824" returned: 0 in 0.531s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:36 devstack sudo[99497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b
Jul 19 19:56:36 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:37 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bddd173a-da87-4019-83b1-98be362c6c88" returned: 0 in 0.282s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "cinder-quobyte-bddd173a-da87-4019-83b1-98be362c6c88" released by "delete_volume" :: held 0.750s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Created reservations ['6560c5fa-6226-49f2-8c81-82b9c4dcd86d', '643e456e-8809-4865-b763-3dad357bdb5c', '496f4372-6172-4838-afc2-92e118d80cb1', 'f0fc15c5-57c3-436f-a556-1b1bf6cdfd5f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:37 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:37 devstack sudo[99501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:37 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c889eb-7982-46e4-836c-a59d80899847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15701357-0317-44b9-ab82-47bc564c1e8b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec6949d-e725-4ec5-bc22-7cd686981d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Volume volume-15701357-0317-44b9-ab82-47bc564c1e8b (15701357-0317-44b9-ab82-47bc564c1e8b): created successfully
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec6949d-e725-4ec5-bc22-7cd686981d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (9296de7d-cab9-46fb-bccd-20df06a1238d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b999a958-fdd2-458c-aa01-966ff6c5cb55 tempest-VolumesGetTest-656397604 None] Created volume successfully.
Jul 19 19:56:37 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.275s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Deleted volume successfully.
Jul 19 19:56:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-896d70df-e57e-49f9-a4a8-6154f4e2974c tempest-VolumeQuotasNegativeTestJSON-1351858093 None] Lock "cinder-bddd173a-da87-4019-83b1-98be362c6c88-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-15701357-0317-44b9-ab82-47bc564c1e8b-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Lock "cinder-15701357-0317-44b9-ab82-47bc564c1e8b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-15701357-0317-44b9-ab82-47bc564c1e8b" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-15701357-0317-44b9-ab82-47bc564c1e8b" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d71b87-0be8-41b2-94f7-1f30a8b5358b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:38 devstack sudo[99504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b
Jul 19 19:56:38 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:38 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b" returned: 0 in 0.393s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:38 devstack sudo[99509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b
Jul 19 19:56:38 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:38 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-15701357-0317-44b9-ab82-47bc564c1e8b" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-15701357-0317-44b9-ab82-47bc564c1e8b" released by "delete_volume" :: held 0.732s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Created reservations ['b1236fec-c77d-4399-966a-04ee5aaf05dc', '726e0ff9-e2b8-4333-abab-ab11b04fae1c', 'af5baea6-ac0d-4550-9f10-26327ed95d98', 'fcb79cde-e96e-4b43-bffb-8b40b04ca730'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:39 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:39 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD, size 20.69 MB, duration 4.55 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 19:56:39 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Image download 20.69 MB at 4.54 MB/s
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-73e2c00c-5767-41ee-9233-c2c3e946d3f0-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:39 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b33c107-ded7-4f97-a0cd-4d260f162613]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Deleted volume successfully.
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Lock "cinder-73e2c00c-5767-41ee-9233-c2c3e946d3f0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ad615c12-dc27-4bff-8691-e8217ef80bcb tempest-VolumesGetTest-656397604 None] Lock "cinder-15701357-0317-44b9-ab82-47bc564c1e8b-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-73e2c00c-5767-41ee-9233-c2c3e946d3f0" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-73e2c00c-5767-41ee-9233-c2c3e946d3f0" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[42669491-44cf-42e9-a798-4bcea414570a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:39 devstack sudo[99516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD
Jul 19 19:56:39 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:39 devstack sudo[99518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0
Jul 19 19:56:39 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:39 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Temporary image 5a628cc4-6b93-4edb-97bc-83b2dcf8a007 is fetched for user bf14374a8cae46e1bcfe899cc6a07426. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a950aea-fb08-4cd5-8d9e-61fe18306b08]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:39 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0" returned: 0 in 0.442s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:39 devstack sudo[99526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD
Jul 19 19:56:39 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:39 devstack sudo[99529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0
Jul 19 19:56:39 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:40 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1701672347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63340f06-b17c-4d27-8bff-207dec1721f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2844b2c5a4dd4be1ac1e9896b884ac3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:34Z,use_quota=True,user_id='bf14374a8cae46e1bcfe899cc6a07426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03654b97-496b-49bb-923e-e794cdbd3df0),volume_type_id=03654b97-496b-49bb-923e-e794cdbd3df0)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Creating volume 63340f06-b17c-4d27-8bff-207dec1721f3 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:40 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:40 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-73e2c00c-5767-41ee-9233-c2c3e946d3f0" returned: 0 in 0.291s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-73e2c00c-5767-41ee-9233-c2c3e946d3f0" released by "delete_volume" :: held 0.792s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:40 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 1073741824
Jul 19 19:56:40 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Created reservations ['7e5d4c1c-5343-4e06-a1bd-7d3da2bf0194', 'fcd0793f-eb48-40a9-8e39-b459745b3bf9', 'e1255e0f-bc1d-411b-a9a6-4c2b1208ea05', 'a7633071-29e4-4e68-991c-acfc62598f3f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:40 devstack sudo[99538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:40 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Lock "cinder-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:40 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.374s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Deleted volume successfully.
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae8e48d-2833-4785-91db-965a3c5b30a7]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:40 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 1073741824" returned: 0 in 0.588s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f318756-3896-4496-a4ae-1629911dfdf5 tempest-VolumesGetTest-656397604 None] Lock "cinder-73e2c00c-5767-41ee-9233-c2c3e946d3f0-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:40 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3
Jul 19 19:56:40 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:40 devstack sudo[99545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb
Jul 19 19:56:40 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:41 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3" returned: 0 in 0.281s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Attempting download of 5a628cc4-6b93-4edb-97bc-83b2dcf8a007 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'metadata': {}}])) to volume 63340f06-b17c-4d27-8bff-207dec1721f3. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 19:56:41 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" returned: 0 in 0.403s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:41 devstack sudo[99553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb
Jul 19 19:56:41 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d495e0d8-6eae-44f2-94db-95fcdae39351]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_qw1bt72_ {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:41 devstack sudo[99555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_qw1bt72_
Jul 19 19:56:41 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:41 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" returned: 0 in 0.275s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb" released by "delete_volume" :: held 0.759s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Created reservations ['97cabb33-410b-4f05-a860-7a11bd91d3cf', '0edf3e98-860d-40e3-9ce8-ee54e6996376', '8a6494d3-3f85-4aba-bd9b-07acefe6c93c', '3eb1bb54-8b3c-43f6-8307-e6109ebdf942'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:41 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_qw1bt72_" returned: 0 in 0.332s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_qw1bt72_ {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:41 devstack sudo[99562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:41 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:41 devstack sudo[99561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_qw1bt72_
Jul 19 19:56:41 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:41 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_qw1bt72_" returned: 1 in 0.334s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_qw1bt72_' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[27037065-d3e3-4ea6-92c2-22b69d9121cb]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:41 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.310s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Deleted volume successfully.
Jul 19 19:56:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dd93158d-7de8-445f-8971-e86b77e6244e tempest-VolumesGetTest-656397604 None] Lock "cinder-f0df0bdc-65dd-4ed0-9f62-1c5cfe3fdbbb-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:42 devstack sudo[99568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD
Jul 19 19:56:42 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:42 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] 5a628cc4-6b93-4edb-97bc-83b2dcf8a007 was qcow2, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:42 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3
Jul 19 19:56:42 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (6f99aee6-280c-4940-9551-8e6de061d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c45f1da-2b54-4325-b563-82a9dba01016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c45f1da-2b54-4325-b563-82a9dba01016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1371566569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91713926-fa38-4bff-9678-0d577c7177b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:43Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ebabe8-8fda-4493-922c-a8f722063792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ebabe8-8fda-4493-922c-a8f722063792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1380b704-13f3-4469-b8a4-f37fdf579477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:42 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1380b704-13f3-4469-b8a4-f37fdf579477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91713926-fa38-4bff-9678-0d577c7177b1', 'volume_name': 'volume-91713926-fa38-4bff-9678-0d577c7177b1', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cba88f0>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f2d3b3-82c4-4236-890f-3b13e4e61b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f2d3b3-82c4-4236-890f-3b13e4e61b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bddb5e6-e82b-4d14-856d-9db4d9dd5fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:43 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Volume 91713926-fa38-4bff-9678-0d577c7177b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91713926-fa38-4bff-9678-0d577c7177b1', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cba88f0>}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Trying to clone 91713926-fa38-4bff-9678-0d577c7177b1 from image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab at location (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 19:56:43 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Image download 20.69 MB at 20.69 MB/s
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[765307bf-218e-4bab-bb1a-6115b42e6f79]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:43 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD
Jul 19 19:56:43 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Flow 'volume_create_manager' (517c0b1b-ac91-4b48-8a9d-a33f9c4af508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a0f7b0-70c9-4116-b685-833f87db1fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a0f7b0-70c9-4116-b685-833f87db1fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-328633573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48803264-8ef7-446d-b832-3c11892d5787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eac85f143d4f40b7c27158e69d7fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:44Z,use_quota=True,user_id='c4a98776bd614fc9b7dac82f59fee00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28919de2-5323-43a0-8e54-d261e314f019),volume_type_id=28919de2-5323-43a0-8e54-d261e314f019)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a31db4c-c0d2-420e-8f8a-ac499cbf7fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a31db4c-c0d2-420e-8f8a-ac499cbf7fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d91351-55eb-4b79-af21-f1d0ecba4474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d91351-55eb-4b79-af21-f1d0ecba4474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48803264-8ef7-446d-b832-3c11892d5787', 'volume_name': 'volume-48803264-8ef7-446d-b832-3c11892d5787', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827c0ddc-db0a-473d-8675-981c865ffb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827c0ddc-db0a-473d-8675-981c865ffb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb78f42b-df13-4d5c-9a26-64aa1d887dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:43 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Volume 48803264-8ef7-446d-b832-3c11892d5787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48803264-8ef7-446d-b832-3c11892d5787', 'volume_size': 1}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-328633573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48803264-8ef7-446d-b832-3c11892d5787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eac85f143d4f40b7c27158e69d7fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:44Z,use_quota=True,user_id='c4a98776bd614fc9b7dac82f59fee00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28919de2-5323-43a0-8e54-d261e314f019),volume_type_id=28919de2-5323-43a0-8e54-d261e314f019)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Creating volume 48803264-8ef7-446d-b832-3c11892d5787 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:43 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:43 devstack sudo[99585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787 1073741824
Jul 19 19:56:43 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:43 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Temporary image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab is fetched for user 5ac7ca941df246a2821b22d2149cbf48. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[297ed39b-de0d-4f5b-ae76-8f4dfa4993ac]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:44 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD
Jul 19 19:56:44 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:44 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787 1073741824" returned: 0 in 0.545s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:44 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3" returned: 0 in 2.089s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a628cc4-6b93-4edb-97bc-83b2dcf8a007_7ja0362bdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:56:44 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Converted 112.00 MB image at 53.59 MB/s
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:44 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:44 devstack sudo[99600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 1G
Jul 19 19:56:44 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:44 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787
Jul 19 19:56:44 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:44 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787" returned: 0 in 0.271s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1371566569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91713926-fa38-4bff-9678-0d577c7177b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:43Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Creating volume 91713926-fa38-4bff-9678-0d577c7177b1 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:44 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:44 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 1G" returned: 0 in 0.343s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Downloaded image 5a628cc4-6b93-4edb-97bc-83b2dcf8a007 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'metadata': {}}])) to volume 63340f06-b17c-4d27-8bff-207dec1721f3 successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Temporary image 5a628cc4-6b93-4edb-97bc-83b2dcf8a007 for user bf14374a8cae46e1bcfe899cc6a07426 is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Marking volume 63340f06-b17c-4d27-8bff-207dec1721f3 as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 19:56:44 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 1073741824
Jul 19 19:56:44 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb78f42b-df13-4d5c-9a26-64aa1d887dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48803264-8ef7-446d-b832-3c11892d5787', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6684b0bd-86b1-4982-949c-2207dfa0d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Copying metadata from image 5a628cc4-6b93-4edb-97bc-83b2dcf8a007 to 63340f06-b17c-4d27-8bff-207dec1721f3. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Creating volume glance metadata for volume 63340f06-b17c-4d27-8bff-207dec1721f3 backed by image 5a628cc4-6b93-4edb-97bc-83b2dcf8a007 with: {'image_id': '5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'image_name': 'tempest-scenario-img--251932364', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 19:56:44 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Volume volume-48803264-8ef7-446d-b832-3c11892d5787 (48803264-8ef7-446d-b832-3c11892d5787): created successfully
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6684b0bd-86b1-4982-949c-2207dfa0d15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Flow 'volume_create_manager' (517c0b1b-ac91-4b48-8a9d-a33f9c4af508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-abee8d6d-0fc3-4cb6-bb76-83591aea5827 tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Created volume successfully.
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1d56b1-f1dd-4c3f-9ffb-8844f3ceb263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63340f06-b17c-4d27-8bff-207dec1721f3', 'volume_size': 1, 'image_id': '5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--251932364', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2844b2c5a4dd4be1ac1e9896b884ac3b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a628cc4-6b93-4edb-97bc-83b2dcf8a007', 'created_at': datetime.datetime(2026, 7, 19, 17, 56, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 56, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a628cc4-6b93-4edb-97bc-83b2dcf8a007/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb0410>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe49fe0-af96-4cbb-9849-26521cfdce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:44 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Volume volume-63340f06-b17c-4d27-8bff-207dec1721f3 (63340f06-b17c-4d27-8bff-207dec1721f3): created successfully
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe49fe0-af96-4cbb-9849-26521cfdce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Flow 'volume_create_manager' (badc11a5-337d-47cf-b6c5-314406d5bca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-76ec850d-529d-404c-bdf8-01b0ea6d6d0c tempest-TestInstancesWithCinderVolumes-290215021 None] Created volume successfully.
Jul 19 19:56:45 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 1073741824" returned: 0 in 0.393s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:45 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1
Jul 19 19:56:45 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:45 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1" returned: 0 in 0.248s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Attempting download of 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab ((None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}])) to volume 91713926-fa38-4bff-9678-0d577c7177b1. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc576064-0139-4723-b022-c88831bd9740]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_dvivo8qn {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:45 devstack sudo[99616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_dvivo8qn
Jul 19 19:56:45 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:45 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_dvivo8qn" returned: 0 in 0.342s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_dvivo8qn {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:45 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_dvivo8qn
Jul 19 19:56:45 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:46 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_dvivo8qn" returned: 1 in 0.352s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_dvivo8qn' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d36713-c9ce-48dd-aed5-f439372a8736]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:46 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:46 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:46 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD
Jul 19 19:56:46 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:46 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9afcdb0c-a3f3-4c78-8415-ddcbf60e8fba tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Retype volume completed successfully.
Jul 19 19:56:46 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab was qcow2, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 19:56:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:46 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1
Jul 19 19:56:46 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Acquiring lock "cinder-48803264-8ef7-446d-b832-3c11892d5787-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "cinder-48803264-8ef7-446d-b832-3c11892d5787-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Acquiring lock "cinder-quobyte-48803264-8ef7-446d-b832-3c11892d5787" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "cinder-quobyte-48803264-8ef7-446d-b832-3c11892d5787" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc690ca-ca10-4caf-89ba-8fe1e34aa14d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:47 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787
Jul 19 19:56:47 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:48 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787" returned: 0 in 0.550s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:48 devstack sudo[99656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787
Jul 19 19:56:48 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-85018446-ae54-4afc-aae3-46d2118c5aff req-58cba9fa-0e3c-4d32-8c01-814648d6255a tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-85018446-ae54-4afc-aae3-46d2118c5aff req-58cba9fa-0e3c-4d32-8c01-814648d6255a tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-85018446-ae54-4afc-aae3-46d2118c5aff req-58cba9fa-0e3c-4d32-8c01-814648d6255a tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-85018446-ae54-4afc-aae3-46d2118c5aff req-58cba9fa-0e3c-4d32-8c01-814648d6255a tempest-TestInstancesWithCinderVolumes-290215021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-63340f06-b17c-4d27-8bff-207dec1721f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8745e2a2-35ce-475e-98ce-d6cb8ce11a83', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:56:48 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-48803264-8ef7-446d-b832-3c11892d5787" returned: 0 in 0.305s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "cinder-quobyte-48803264-8ef7-446d-b832-3c11892d5787" released by "delete_volume" :: held 0.920s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:48 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-85018446-ae54-4afc-aae3-46d2118c5aff req-58cba9fa-0e3c-4d32-8c01-814648d6255a tempest-TestInstancesWithCinderVolumes-290215021 None] attachment_update completed successfully.
Jul 19 19:56:48 devstack cinder-volume[87353]: WARNING cinder.quota [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:56:48 devstack cinder-volume[87353]: WARNING cinder.quota [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Created reservations ['0f7e1934-1b0b-4c42-add9-ff9e306fe2bf', 'af8ee3a1-5aaa-4098-bc87-857beef3b5a6', '9f142bb6-1a9e-48e5-b9e4-ee3ef59deda5', '8f4c663d-b912-4b33-80d9-e4b6e7a33719'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:48 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1" returned: 0 in 2.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_7gg40o26devstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:56:48 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Converted 112.00 MB image at 49.58 MB/s
Jul 19 19:56:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:48 devstack sudo[99660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:48 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:48 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 1G
Jul 19 19:56:48 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:49 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.375s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Deleted volume successfully.
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f94196c8-36b5-4934-be22-f316f534494b tempest-VolumeRetypeWithoutMigrationTest-798227601 None] Lock "cinder-48803264-8ef7-446d-b832-3c11892d5787-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:49 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 1G" returned: 0 in 0.548s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Downloaded image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab ((None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}])) to volume 91713926-fa38-4bff-9678-0d577c7177b1 successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Temporary image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab for user 5ac7ca941df246a2821b22d2149cbf48 is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Marking volume 91713926-fa38-4bff-9678-0d577c7177b1 as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Copying metadata from image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab to 91713926-fa38-4bff-9678-0d577c7177b1. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Creating volume glance metadata for volume 91713926-fa38-4bff-9678-0d577c7177b1 backed by image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bddb5e6-e82b-4d14-856d-9db4d9dd5fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91713926-fa38-4bff-9678-0d577c7177b1', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cba88f0>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f67bdf1-25a7-4cd9-a290-b2aafefd569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:49 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Volume volume-91713926-fa38-4bff-9678-0d577c7177b1 (91713926-fa38-4bff-9678-0d577c7177b1): created successfully
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f67bdf1-25a7-4cd9-a290-b2aafefd569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (6f99aee6-280c-4940-9551-8e6de061d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c8e3339f-09cc-4b76-ad14-8d1824904790 tempest-VolumesGetTest-656397604 None] Created volume successfully.
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (94607f80-6a9f-4178-88d6-3d1aaf5a013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2628ba-bf0b-42e8-ae7a-43a93c0ba53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2628ba-bf0b-42e8-ae7a-43a93c0ba53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-292385012',display_name='tempest-VolumesGetTest-Volume-846848277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2620598-d0d4-4f9c-8823-7c84779d98e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:51Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaa7c28-9791-4a0a-a5c5-60cffd264506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaa7c28-9791-4a0a-a5c5-60cffd264506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc229caa-f36d-4a47-9d8f-5b23b746567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc229caa-f36d-4a47-9d8f-5b23b746567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2620598-d0d4-4f9c-8823-7c84779d98e3', 'volume_name': 'volume-b2620598-d0d4-4f9c-8823-7c84779d98e3', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86425b2-07f5-49c6-ac01-8bb5ba0fc135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86425b2-07f5-49c6-ac01-8bb5ba0fc135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd1159c-95f1-42c1-b180-c6199ef4e08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:51 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Volume b2620598-d0d4-4f9c-8823-7c84779d98e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2620598-d0d4-4f9c-8823-7c84779d98e3', 'volume_size': 1}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-292385012',display_name='tempest-VolumesGetTest-Volume-846848277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2620598-d0d4-4f9c-8823-7c84779d98e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2769e7cf67784b648efa45c16467c9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:51Z,use_quota=True,user_id='5ac7ca941df246a2821b22d2149cbf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Creating volume b2620598-d0d4-4f9c-8823-7c84779d98e3 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:51 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:51 devstack sudo[99745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3 1073741824
Jul 19 19:56:51 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:52 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3 1073741824" returned: 0 in 0.850s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=161,cinder:SELECT=120,cinder:INSERT=41,cinder:DELETE=14 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:52 devstack sudo[100114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3
Jul 19 19:56:52 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:52 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3" returned: 0 in 0.512s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=132,cinder:UPDATE=151,cinder:INSERT=47,cinder:DELETE=9 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd1159c-95f1-42c1-b180-c6199ef4e08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2620598-d0d4-4f9c-8823-7c84779d98e3', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78486811-b633-4238-9a8d-e0bc2a417bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:52 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Volume volume-b2620598-d0d4-4f9c-8823-7c84779d98e3 (b2620598-d0d4-4f9c-8823-7c84779d98e3): created successfully
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78486811-b633-4238-9a8d-e0bc2a417bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Flow 'volume_create_manager' (94607f80-6a9f-4178-88d6-3d1aaf5a013c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:52 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-332aac32-5178-4674-8595-99df3a74980a tempest-VolumesGetTest-656397604 None] Created volume successfully.
Jul 19 19:56:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-b2620598-d0d4-4f9c-8823-7c84779d98e3-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Lock "cinder-b2620598-d0d4-4f9c-8823-7c84779d98e3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-b2620598-d0d4-4f9c-8823-7c84779d98e3" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-b2620598-d0d4-4f9c-8823-7c84779d98e3" acquired by "delete_volume" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:53 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f812603e-5afb-466b-b644-91241b722597]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:53 devstack sudo[100126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3
Jul 19 19:56:53 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:54 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3" returned: 0 in 0.448s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:54 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3
Jul 19 19:56:54 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:54 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b2620598-d0d4-4f9c-8823-7c84779d98e3" returned: 0 in 0.326s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-b2620598-d0d4-4f9c-8823-7c84779d98e3" released by "delete_volume" :: held 0.850s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Created reservations ['9740c1aa-2d6f-4129-95ae-1ac9190725e6', '999520a0-f29e-4076-a0ed-f5326a03d8de', 'a586dae0-3724-4861-8ead-a861876f9dc6', '0176a739-a36a-42bf-a3a6-e09f31372cd1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:54 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:54 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-91713926-fa38-4bff-9678-0d577c7177b1-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Lock "cinder-91713926-fa38-4bff-9678-0d577c7177b1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Acquiring lock "cinder-quobyte-91713926-fa38-4bff-9678-0d577c7177b1" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-91713926-fa38-4bff-9678-0d577c7177b1" acquired by "delete_volume" :: waited 0.053s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c87e4-14b8-4ffb-be0b-7666b6ef1719]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:55 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.532s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:55 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Deleted volume successfully.
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-35ecca38-6c6c-43f9-ae8c-c0605f894c9d tempest-VolumesGetTest-656397604 None] Lock "cinder-b2620598-d0d4-4f9c-8823-7c84779d98e3-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:55 devstack sudo[100137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1
Jul 19 19:56:55 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:55 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1" returned: 0 in 0.575s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:55 devstack sudo[100144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1
Jul 19 19:56:55 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:56 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-91713926-fa38-4bff-9678-0d577c7177b1" returned: 0 in 0.396s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Lock "cinder-quobyte-91713926-fa38-4bff-9678-0d577c7177b1" released by "delete_volume" :: held 1.044s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Created reservations ['ab600b68-a3ce-41ea-9cbb-7b0d5ad6a212', '139b8f47-8978-43b0-9770-794e868beb29', '0730b5f6-e544-4d86-85da-aebd092fb893', '6e839278-57cd-4a20-aaff-79a8051b553f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:56 devstack sudo[100148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:56:56 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:56 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.322s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:56:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Deleted volume successfully.
Jul 19 19:56:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3b3d31bb-4b6f-4680-9af3-33fcc66826e7 tempest-VolumesGetTest-656397604 None] Lock "cinder-91713926-fa38-4bff-9678-0d577c7177b1-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Flow 'volume_create_manager' (903f32a3-27d2-43fd-a6de-ccdd5641b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eacf7d-ec26-44e7-8cb5-6c6caa9245b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eacf7d-ec26-44e7-8cb5-6c6caa9245b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1269853521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11764659-6865-41c8-b32f-311dac3c2a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bee2d73b91441b1b1083e59d4eff68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:58Z,use_quota=True,user_id='ae33a152d80f467ebc61df116810e274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ec0ff1-787d-466a-a1ac-1ef9a8e2c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ec0ff1-787d-466a-a1ac-1ef9a8e2c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9cf93d-d86b-420b-9ce7-615e493ae13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9cf93d-d86b-420b-9ce7-615e493ae13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11764659-6865-41c8-b32f-311dac3c2a6f', 'volume_name': 'volume-11764659-6865-41c8-b32f-311dac3c2a6f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfc1b7c-b1d1-4c80-a9bf-2f851c50f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfc1b7c-b1d1-4c80-a9bf-2f851c50f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec4af6f-69e4-406e-a9e3-6ba954fffde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:58 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Volume 11764659-6865-41c8-b32f-311dac3c2a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11764659-6865-41c8-b32f-311dac3c2a6f', 'volume_size': 1}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1269853521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11764659-6865-41c8-b32f-311dac3c2a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bee2d73b91441b1b1083e59d4eff68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:56:58Z,use_quota=True,user_id='ae33a152d80f467ebc61df116810e274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Creating volume 11764659-6865-41c8-b32f-311dac3c2a6f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:56:58 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:56:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:58 devstack sudo[100153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f 1073741824
Jul 19 19:56:58 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:59 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f 1073741824" returned: 0 in 0.729s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:56:59 devstack sudo[100158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f
Jul 19 19:56:59 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:56:59 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f" returned: 0 in 0.352s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec4af6f-69e4-406e-a9e3-6ba954fffde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11764659-6865-41c8-b32f-311dac3c2a6f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0197aee-3277-41ce-b736-25c4e3c533c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:56:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Volume volume-11764659-6865-41c8-b32f-311dac3c2a6f (11764659-6865-41c8-b32f-311dac3c2a6f): created successfully
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0197aee-3277-41ce-b736-25c4e3c533c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:56:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Flow 'volume_create_manager' (903f32a3-27d2-43fd-a6de-ccdd5641b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:56:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d32d5996-4feb-44c3-ba2b-35d0d5ff9387 tempest-VolumesServicesTestJSON-1484038819 None] Created volume successfully.
Jul 19 19:57:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Acquiring lock "cinder-11764659-6865-41c8-b32f-311dac3c2a6f-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Lock "cinder-11764659-6865-41c8-b32f-311dac3c2a6f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Acquiring lock "cinder-quobyte-11764659-6865-41c8-b32f-311dac3c2a6f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Lock "cinder-quobyte-11764659-6865-41c8-b32f-311dac3c2a6f" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:00 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b539306-e513-442a-9b14-e44bac6942c2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:01 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f
Jul 19 19:57:01 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:01 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f" returned: 0 in 0.586s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:01 devstack sudo[100166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f
Jul 19 19:57:01 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:01 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-11764659-6865-41c8-b32f-311dac3c2a6f" returned: 0 in 0.316s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Lock "cinder-quobyte-11764659-6865-41c8-b32f-311dac3c2a6f" released by "delete_volume" :: held 0.963s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:01 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Created reservations ['84af54eb-f990-4748-87e0-a15623cba54b', '085f8d7f-5e24-413f-9d71-31af0cb1c37a', '293962f4-af70-4e6c-979d-bc40f811a7f1', '23306a5c-7a8b-49df-8ee4-bd4288a8ac16'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:02 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:02 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:02 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.394s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Deleted volume successfully.
Jul 19 19:57:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f14c5dce-1def-477e-a2ff-439b335732fe tempest-VolumesServicesTestJSON-1484038819 None] Lock "cinder-11764659-6865-41c8-b32f-311dac3c2a6f-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Flow 'volume_create_manager' (a95f5f37-1c31-4d3f-ae34-44b061ff875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad834235-9305-43d9-bcb6-fa9f179b6a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad834235-9305-43d9-bcb6-fa9f179b6a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1979038706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9936aef-89e7-4ebb-8c66-6e15afded6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e252dcf06943c4991dce5c4719683e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:10Z,use_quota=True,user_id='208cb28460ba4a11ae57cf285835e4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a91132-1027-4b97-bf08-2dcfffb1edfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a91132-1027-4b97-bf08-2dcfffb1edfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9718259-2b6a-437e-accf-a2ef51224542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9718259-2b6a-437e-accf-a2ef51224542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9936aef-89e7-4ebb-8c66-6e15afded6bb', 'volume_name': 'volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3cdbe0-f6e2-4729-8e88-111ea234bf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3cdbe0-f6e2-4729-8e88-111ea234bf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75718d8e-69e2-474c-b275-3fa6353d1ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:09 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Volume d9936aef-89e7-4ebb-8c66-6e15afded6bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb', 'volume_size': 1}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1979038706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9936aef-89e7-4ebb-8c66-6e15afded6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e252dcf06943c4991dce5c4719683e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:10Z,use_quota=True,user_id='208cb28460ba4a11ae57cf285835e4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Creating volume d9936aef-89e7-4ebb-8c66-6e15afded6bb {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:57:09 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:57:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:09 devstack sudo[100181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb 1073741824
Jul 19 19:57:09 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:10 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb 1073741824" returned: 0 in 0.562s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:10 devstack sudo[100192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb
Jul 19 19:57:10 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:10 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb" returned: 0 in 0.282s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75718d8e-69e2-474c-b275-3fa6353d1ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793ce8e2-4991-4acf-837e-582ddae0c834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:10 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Volume volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb (d9936aef-89e7-4ebb-8c66-6e15afded6bb): created successfully
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793ce8e2-4991-4acf-837e-582ddae0c834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Flow 'volume_create_manager' (a95f5f37-1c31-4d3f-ae34-44b061ff875b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c81b613a-f807-49b6-93f5-e66d85ece6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Created volume successfully.
Jul 19 19:57:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Creating offline snapshot 2f44c507-493c-428e-bc3f-fc45fc479508 of volume d9936aef-89e7-4ebb-8c66-6e15afded6bb {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:57:12 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3055e4c6-1c1f-4341-9d8e-998c58ee748b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:12 devstack sudo[100219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb
Jul 19 19:57:12 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:12 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb" returned: 0 in 0.454s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:12 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 1G
Jul 19 19:57:12 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:12 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 1G" returned: 0 in 0.465s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:12 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508
Jul 19 19:57:12 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:57:13 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (683b3d2a-fc59-4a52-8551-1895921a0046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed273a7-bea1-422d-8c66-25f13435571e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508" returned: 0 in 0.368s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:13 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 is being set with open permissions: ugo+rw
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed273a7-bea1-422d-8c66-25f13435571e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2007267582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ff9787-39e6-45d0-a049-c9065efe87cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e38fd3badf45b3afd53a09151794e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:13Z,use_quota=True,user_id='9ce5108b682b43dda52bca701d9de9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:13 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508
Jul 19 19:57:13 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b558ca38-98ff-46ff-b286-21392decdf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b558ca38-98ff-46ff-b286-21392decdf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b67c38-1635-489c-8242-93e1a0931014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b67c38-1635-489c-8242-93e1a0931014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ff9787-39e6-45d0-a049-c9065efe87cf', 'volume_name': 'volume-d0ff9787-39e6-45d0-a049-c9065efe87cf', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cb4bf9-dc33-45a0-a765-d455a3151749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cb4bf9-dc33-45a0-a765-d455a3151749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37c4cf7-87d6-4e45-833f-15edec49cd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:13 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Volume d0ff9787-39e6-45d0-a049-c9065efe87cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ff9787-39e6-45d0-a049-c9065efe87cf', 'volume_size': 1}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:13 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508" returned: 0 in 0.252s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:13 devstack sudo[100238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.info
Jul 19 19:57:13 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:13 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.info" returned: 0 in 0.251s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:13 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.info is being set with open permissions: ugo+rw
Jul 19 19:57:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:13 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.info
Jul 19 19:57:13 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:14 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.info" returned: 0 in 0.247s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2007267582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ff9787-39e6-45d0-a049-c9065efe87cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e38fd3badf45b3afd53a09151794e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:13Z,use_quota=True,user_id='9ce5108b682b43dda52bca701d9de9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Creating volume d0ff9787-39e6-45d0-a049-c9065efe87cf {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:57:14 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:14 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf 1073741824
Jul 19 19:57:14 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:14 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f0d93832-10f0-4e26-b717-d08fdbd78622 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Create snapshot completed successfully
Jul 19 19:57:14 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf 1073741824" returned: 0 in 0.409s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:14 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf
Jul 19 19:57:14 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:14 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37c4cf7-87d6-4e45-833f-15edec49cd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ff9787-39e6-45d0-a049-c9065efe87cf', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd591d2f-7e74-4e39-abdd-194d4cde03bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:14 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Volume volume-d0ff9787-39e6-45d0-a049-c9065efe87cf (d0ff9787-39e6-45d0-a049-c9065efe87cf): created successfully
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd591d2f-7e74-4e39-abdd-194d4cde03bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (683b3d2a-fc59-4a52-8551-1895921a0046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:14 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9d12d4e4-78ce-43c2-9ef1-a4b1c239f5f6 tempest-VolumesSnapshotTestJSON-1820592518 None] Created volume successfully.
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "cinder-2f44c507-493c-428e-bc3f-fc45fc479508-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-2f44c507-493c-428e-bc3f-fc45fc479508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "cinder-quobyte-d9936aef-89e7-4ebb-8c66-6e15afded6bb" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-quobyte-d9936aef-89e7-4ebb-8c66-6e15afded6bb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "cinder-quobyte-2f44c507-493c-428e-bc3f-fc45fc479508" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Creating offline snapshot d24627e8-eb48-4a97-977c-a694d663e489 of volume d0ff9787-39e6-45d0-a049-c9065efe87cf {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-quobyte-2f44c507-493c-428e-bc3f-fc45fc479508" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Deleting offline snapshot 2f44c507-493c-428e-bc3f-fc45fc479508 of volume d9936aef-89e7-4ebb-8c66-6e15afded6bb {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] snapshot_file for this snap is: volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8564d1a-de32-481c-8613-5f1eaae0e12c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e5fa2a-f1a3-4cf3-b610-38a985a7a6b3]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:15 devstack sudo[100254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf
Jul 19 19:57:15 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:15 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508
Jul 19 19:57:15 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:15 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf" returned: 0 in 0.360s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:15 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508" returned: 0 in 0.360s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:57:15 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 1G
Jul 19 19:57:15 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[49816659-52b9-407f-a376-59b5e7054343]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:16 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb
Jul 19 19:57:16 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:16 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb" returned: 0 in 0.391s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:16 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 1G" returned: 0 in 0.448s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ff9787-39e6-45d0-a049-c9065efe87cf -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:16 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508
Jul 19 19:57:16 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:16 devstack sudo[100276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ff9787-39e6-45d0-a049-c9065efe87cf -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489
Jul 19 19:57:16 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:16 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ff9787-39e6-45d0-a049-c9065efe87cf -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489" returned: 0 in 0.344s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:16 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 is being set with open permissions: ugo+rw
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:16 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489
Jul 19 19:57:16 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:16 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:16 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508
Jul 19 19:57:16 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:17 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:17 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb.2f44c507-493c-428e-bc3f-fc45fc479508" returned: 0 in 0.282s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:17 devstack sudo[100293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.info
Jul 19 19:57:17 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-quobyte-2f44c507-493c-428e-bc3f-fc45fc479508" released by "_delete_snapshot" :: held 1.578s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-quobyte-d9936aef-89e7-4ebb-8c66-6e15afded6bb" released by "delete_snapshot" :: held 1.605s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Created reservations ['2a2ec9b2-dd72-4c52-a0e2-fbaad5f1303b', 'ec77a1bc-d936-4cb3-bce8-1bb04a28caf1', 'd7e7dfaa-f1f5-4070-9113-095cc6aca019', '9714f1cc-b0a7-44a0-9767-92aa28737951'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Delete snapshot completed successfully.
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fc115c0b-b184-4053-9c58-aca9ac6d5e95 tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-2f44c507-493c-428e-bc3f-fc45fc479508-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:17 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.info" returned: 0 in 0.266s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:17 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.info is being set with open permissions: ugo+rw
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:17 devstack sudo[100296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.info
Jul 19 19:57:17 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:17 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.info" returned: 0 in 0.265s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-fc3df5df-8faa-4c8b-9e38-1fe3e5933209 tempest-VolumesSnapshotTestJSON-1820592518 None] Create snapshot completed successfully
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "cinder-d9936aef-89e7-4ebb-8c66-6e15afded6bb-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-d9936aef-89e7-4ebb-8c66-6e15afded6bb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "cinder-quobyte-d9936aef-89e7-4ebb-8c66-6e15afded6bb" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-quobyte-d9936aef-89e7-4ebb-8c66-6e15afded6bb" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc854632-a655-4b43-a29d-781cbc8cd668]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:17 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb
Jul 19 19:57:17 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:18 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb" returned: 0 in 0.375s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:18 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb
Jul 19 19:57:18 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:18 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d9936aef-89e7-4ebb-8c66-6e15afded6bb" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-quobyte-d9936aef-89e7-4ebb-8c66-6e15afded6bb" released by "delete_volume" :: held 0.684s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Created reservations ['7aff37b8-273f-40e2-98a6-11c1186db31b', '34be9ece-c8fd-4c19-bb31-32c0becb975d', 'dc9acbca-1a41-4168-9573-ff4bd6264b83', '40845c8f-ce98-4dde-844e-289fc8dcf6d3'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:18 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:18 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-d24627e8-eb48-4a97-977c-a694d663e489-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-d24627e8-eb48-4a97-977c-a694d663e489-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:18 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.331s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:18 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:18 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Deleted volume successfully.
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-d0ff9787-39e6-45d0-a049-c9065efe87cf" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4a2c8296-31cd-454f-a184-cf7812686d1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1720103264 None] Lock "cinder-d9936aef-89e7-4ebb-8c66-6e15afded6bb-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-d0ff9787-39e6-45d0-a049-c9065efe87cf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-d24627e8-eb48-4a97-977c-a694d663e489" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-d24627e8-eb48-4a97-977c-a694d663e489" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Deleting offline snapshot d24627e8-eb48-4a97-977c-a694d663e489 of volume d0ff9787-39e6-45d0-a049-c9065efe87cf {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] snapshot_file for this snap is: volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c287695-3d59-4971-8101-ceef14bff0ec]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:19 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489
Jul 19 19:57:19 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:19 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489" returned: 0 in 0.363s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0ff9787-39e6-45d0-a049-c9065efe87cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a80abd0-2b95-40d7-9057-d82173f09610]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:19 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf
Jul 19 19:57:19 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:19 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf" returned: 0 in 0.382s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:19 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489
Jul 19 19:57:19 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:20 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489" returned: 0 in 0.366s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:20 devstack sudo[100333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489
Jul 19 19:57:20 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:20 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf.d24627e8-eb48-4a97-977c-a694d663e489" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-d24627e8-eb48-4a97-977c-a694d663e489" released by "_delete_snapshot" :: held 1.508s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-d0ff9787-39e6-45d0-a049-c9065efe87cf" released by "delete_snapshot" :: held 1.538s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:20 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Created reservations ['75037fbb-b311-4d07-990c-3bc242fcbdf2', '43f52979-a25b-4cd3-b4c8-7ac1e9652ab1', '8bf6098d-e172-4641-b326-39fc673267a4', 'ca25a3ec-ae0e-41bf-94db-c463dbf4860b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:20 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Delete snapshot completed successfully.
Jul 19 19:57:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-41eddb3e-5c2a-4717-a15f-ea979adbf0d9 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-d24627e8-eb48-4a97-977c-a694d663e489-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (7b796195-19c9-46b0-b5a2-0f413e79091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de685b3-9f2b-40da-a7bc-c2f42cbe7b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de685b3-9f2b-40da-a7bc-c2f42cbe7b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1897683450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca46f075-0da6-4eed-bb7d-e8c30bc68602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e38fd3badf45b3afd53a09151794e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:22Z,use_quota=True,user_id='9ce5108b682b43dda52bca701d9de9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5775e879-481d-4f78-87e4-6aa3e01f0ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5775e879-481d-4f78-87e4-6aa3e01f0ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1ba38e-bfde-478a-9750-0ab1e88dc398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1ba38e-bfde-478a-9750-0ab1e88dc398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca46f075-0da6-4eed-bb7d-e8c30bc68602', 'volume_name': 'volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ec3e92-3104-4776-89b1-8f28752662c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ec3e92-3104-4776-89b1-8f28752662c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436e72a1-fcfe-4b6c-9c78-867f163aad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:21 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Volume ca46f075-0da6-4eed-bb7d-e8c30bc68602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602', 'volume_size': 1}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1897683450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca46f075-0da6-4eed-bb7d-e8c30bc68602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e38fd3badf45b3afd53a09151794e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:22Z,use_quota=True,user_id='9ce5108b682b43dda52bca701d9de9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Creating volume ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:57:21 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:57:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:21 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 1073741824
Jul 19 19:57:21 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:22 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 1073741824" returned: 0 in 0.445s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:22 devstack sudo[100378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602
Jul 19 19:57:22 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:22 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602" returned: 0 in 0.261s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436e72a1-fcfe-4b6c-9c78-867f163aad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4687a270-bdd8-451b-b426-4faf3a1091b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:22 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Volume volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 (ca46f075-0da6-4eed-bb7d-e8c30bc68602): created successfully
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4687a270-bdd8-451b-b426-4faf3a1091b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (7b796195-19c9-46b0-b5a2-0f413e79091a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4267cb00-41dc-49e1-98f2-d7aea39cf40d tempest-VolumesSnapshotTestJSON-1820592518 None] Created volume successfully.
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Creating offline snapshot ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 of volume ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[53987438-6fc9-4837-95d4-1de9f817820c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:22 devstack sudo[100381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602
Jul 19 19:57:22 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:23 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602" returned: 0 in 0.416s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:23 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 1G
Jul 19 19:57:23 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:23 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 1G" returned: 0 in 0.516s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:23 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4
Jul 19 19:57:23 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:24 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" returned: 0 in 0.391s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:24 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 is being set with open permissions: ugo+rw
Jul 19 19:57:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:24 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4
Jul 19 19:57:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-949379d3-b3c7-4adf-8fd9-bc99bba97bfb req-bf7516e1-80ce-47e1-9398-4f1d3fcf7c4f tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:24 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:24 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" returned: 0 in 0.263s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:24 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.info
Jul 19 19:57:24 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:24 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.info" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:24 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.info is being set with open permissions: ugo+rw
Jul 19 19:57:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:24 devstack sudo[100419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.info
Jul 19 19:57:24 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:25 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.info" returned: 0 in 0.270s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-949379d3-b3c7-4adf-8fd9-bc99bba97bfb req-bf7516e1-80ce-47e1-9398-4f1d3fcf7c4f tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.830s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-949379d3-b3c7-4adf-8fd9-bc99bba97bfb req-bf7516e1-80ce-47e1-9398-4f1d3fcf7c4f tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-58d5fa9a-2f35-4d3e-bcb5-2a2166d9a9fd tempest-VolumesSnapshotTestJSON-1820592518 None] Create snapshot completed successfully
Jul 19 19:57:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-949379d3-b3c7-4adf-8fd9-bc99bba97bfb req-bf7516e1-80ce-47e1-9398-4f1d3fcf7c4f tempest-TestInstancesWithCinderVolumes-290215021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-84117ab5-f514-4f61-9eff-05e7e1386dc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79d5aa29-0972-44de-aa12-06491a9138f9', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:57:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-949379d3-b3c7-4adf-8fd9-bc99bba97bfb req-bf7516e1-80ce-47e1-9398-4f1d3fcf7c4f tempest-TestInstancesWithCinderVolumes-290215021 None] attachment_update completed successfully.
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (7d266480-f360-4410-a18c-47f853d43779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d22f59d-4242-4d86-820e-bd21e4f2d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d22f59d-4242-4d86-820e-bd21e4f2d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1793756045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb39067-5c97-4295-a992-cb96eb03c70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e38fd3badf45b3afd53a09151794e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:27Z,use_quota=True,user_id='9ce5108b682b43dda52bca701d9de9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b162b961-1342-425c-9dc1-ec85f4c3324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b162b961-1342-425c-9dc1-ec85f4c3324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6dd0fc-ef5c-4750-b4e6-bf03789f66be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6dd0fc-ef5c-4750-b4e6-bf03789f66be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fcb39067-5c97-4295-a992-cb96eb03c70c', 'volume_name': 'volume-fcb39067-5c97-4295-a992-cb96eb03c70c', 'volume_size': 2, 'snapshot_id': 'ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7567a988-9e8e-4474-9546-474971ef3a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7567a988-9e8e-4474-9546-474971ef3a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6dbe2b-d812-4328-b765-bbdc8e6751d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:26 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Volume fcb39067-5c97-4295-a992-cb96eb03c70c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fcb39067-5c97-4295-a992-cb96eb03c70c', 'volume_size': 2, 'snapshot_id': 'ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4'}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4-fcb39067-5c97-4295-a992-cb96eb03c70c" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4-fcb39067-5c97-4295-a992-cb96eb03c70c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Creating volume fcb39067-5c97-4295-a992-cb96eb03c70c from snapshot ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-fcb39067-5c97-4295-a992-cb96eb03c70c" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-fcb39067-5c97-4295-a992-cb96eb03c70c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] snapshot: ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4, volume: fcb39067-5c97-4295-a992-cb96eb03c70c,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[51814c84-ea42-4602-af52-9d95f1ee330f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:27 devstack sudo[100434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4
Jul 19 19:57:27 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:27 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" returned: 0 in 0.511s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-d4587fe7-1506-45a9-a2a7-a17a68f0ccb3 req-51b7f6bb-612a-4a9c-b91f-e03311d9462e tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3a749f-12fb-47ca-abf0-006c5c6bc60e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:27 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602
Jul 19 19:57:27 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:27 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602" returned: 0 in 0.399s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 19:57:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:27 devstack sudo[100452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c
Jul 19 19:57:27 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:32 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c" returned: 0 in 4.913s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6dcd47-3d91-401d-bc28-95615138b490]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:32 devstack sudo[100471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:32 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:32 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602
Jul 19 19:57:32 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:33 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.268s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:57:33 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602" returned: 0 in 0.595s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:57:33 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Converted 1024.00 MB image at 208.34 MB/s
Jul 19 19:57:33 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c is being set with open permissions: ugo+rw
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:33 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c
Jul 19 19:57:33 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:33 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c" returned: 0 in 0.273s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-fcb39067-5c97-4295-a992-cb96eb03c70c" released by "_copy_volume_from_snapshot" :: held 6.799s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4-fcb39067-5c97-4295-a992-cb96eb03c70c" released by "_create_volume_from_snapshot" :: held 6.847s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.867s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-d4587fe7-1506-45a9-a2a7-a17a68f0ccb3 req-51b7f6bb-612a-4a9c-b91f-e03311d9462e tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.230s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-d4587fe7-1506-45a9-a2a7-a17a68f0ccb3 req-51b7f6bb-612a-4a9c-b91f-e03311d9462e tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6dbe2b-d812-4328-b765-bbdc8e6751d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb39067-5c97-4295-a992-cb96eb03c70c', 'volume_size': 2, 'snapshot_id': 'ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451eee6b-5d5f-4999-9ccc-c3f7aa36ff43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Volume volume-fcb39067-5c97-4295-a992-cb96eb03c70c (fcb39067-5c97-4295-a992-cb96eb03c70c): created successfully
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451eee6b-5d5f-4999-9ccc-c3f7aa36ff43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (7d266480-f360-4410-a18c-47f853d43779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-d4587fe7-1506-45a9-a2a7-a17a68f0ccb3 req-51b7f6bb-612a-4a9c-b91f-e03311d9462e tempest-TestInstancesWithCinderVolumes-290215021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-41bd5a52-24b9-4795-821d-1d2565184bc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c7c65ac-8b67-429b-8e58-9a420f12398b', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:57:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-308fa4c9-32f8-4703-85d2-2ce014a534ef tempest-VolumesSnapshotTestJSON-1820592518 None] Created volume successfully.
Jul 19 19:57:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-d4587fe7-1506-45a9-a2a7-a17a68f0ccb3 req-51b7f6bb-612a-4a9c-b91f-e03311d9462e tempest-TestInstancesWithCinderVolumes-290215021 None] attachment_update completed successfully.
Jul 19 19:57:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-fcb39067-5c97-4295-a992-cb96eb03c70c-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-fcb39067-5c97-4295-a992-cb96eb03c70c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-fcb39067-5c97-4295-a992-cb96eb03c70c" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-fcb39067-5c97-4295-a992-cb96eb03c70c" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfafa019-dddf-4d3f-a992-f1d2a1c2ef13]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:34 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c
Jul 19 19:57:34 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:35 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c" returned: 0 in 0.407s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:35 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c
Jul 19 19:57:35 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:35 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fcb39067-5c97-4295-a992-cb96eb03c70c" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-fcb39067-5c97-4295-a992-cb96eb03c70c" released by "delete_volume" :: held 0.709s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Created reservations ['bdee090a-bc9f-41d5-bb04-7df82b2a7348', '054160b0-585f-44d6-b999-a7fae8e001e4', '4a103a7e-a3e5-45c7-8ccd-ab4e00a18bb4', 'b06a4e20-18df-49c9-a07e-a48243079ab2'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:35 devstack sudo[100501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:35 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:35 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.315s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Deleted volume successfully.
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-401738c3-bc6c-4af9-b616-25e5fb8e45e6 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-fcb39067-5c97-4295-a992-cb96eb03c70c-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-ca46f075-0da6-4eed-bb7d-e8c30bc68602" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-ca46f075-0da6-4eed-bb7d-e8c30bc68602" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Deleting offline snapshot ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 of volume ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] snapshot_file for this snap is: volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482125b-a27f-4581-856c-d8d9bbcb5402]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:36 devstack sudo[100504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4
Jul 19 19:57:36 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:36 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" returned: 0 in 0.428s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[388383fd-f32a-4b7b-98fa-6bf2e682ddf6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:36 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602
Jul 19 19:57:36 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Flow 'volume_create_manager' (d0f7def4-ff59-4857-a72f-14ca95a4234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d221905b-e81a-452e-a3f5-6b486381bde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d221905b-e81a-452e-a3f5-6b486381bde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1850400926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe1ca78-a4d4-47a8-9029-43375899bc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6daa0264e245c293c926e069b7ccc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:37Z,use_quota=True,user_id='24ef3601e4a241cdbfb2bbb3986be251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a304db-7bc2-492e-81ab-7aa738ff2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a304db-7bc2-492e-81ab-7aa738ff2c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143a1735-70ba-486b-87a3-ad1419b9183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 19:57:36 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602" returned: 0 in 0.427s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:36 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4
Jul 19 19:57:36 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143a1735-70ba-486b-87a3-ad1419b9183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dbe1ca78-a4d4-47a8-9029-43375899bc20', 'volume_name': 'volume-dbe1ca78-a4d4-47a8-9029-43375899bc20', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb1730>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38ccbd6-d216-4fce-a561-2c81da8dbea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38ccbd6-d216-4fce-a561-2c81da8dbea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1ba30e-461b-4d7c-8bb6-3b8b6132ea98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Volume dbe1ca78-a4d4-47a8-9029-43375899bc20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dbe1ca78-a4d4-47a8-9029-43375899bc20', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb1730>}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Trying to clone dbe1ca78-a4d4-47a8-9029-43375899bc20 from image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab at location (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 19:57:37 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" returned: 0 in 0.451s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:37 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4
Jul 19 19:57:37 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 19:57:37 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Image download 20.69 MB at 20.69 MB/s
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fc8341-8df1-4383-87ae-ba2ad1970fd3]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:37 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602.ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" returned: 0 in 0.297s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:37 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD
Jul 19 19:57:37 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4" released by "_delete_snapshot" :: held 1.741s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-ca46f075-0da6-4eed-bb7d-e8c30bc68602" released by "delete_snapshot" :: held 1.764s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Created reservations ['8cdbaa8c-2403-4088-ba0f-06153a67fea9', '8a9e53a0-7de9-4c3f-8d1a-8851e313e85b', '04c3e5a7-c4af-4f6d-891f-cd9603381218', '297de805-25bb-4aa0-9054-3dc89c1aefa8'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Delete snapshot completed successfully.
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c092677-5454-4a8f-88aa-02e665445c69 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-ff5ee18e-d7e7-4cbf-89aa-c60ba178ccb4-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:37 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:37 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Temporary image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab is fetched for user 24ef3601e4a241cdbfb2bbb3986be251. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7b42cf-e0de-4308-a4de-a1988024b89b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:38 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD
Jul 19 19:57:38 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-ca46f075-0da6-4eed-bb7d-e8c30bc68602-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-ca46f075-0da6-4eed-bb7d-e8c30bc68602-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-ca46f075-0da6-4eed-bb7d-e8c30bc68602" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-ca46f075-0da6-4eed-bb7d-e8c30bc68602" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb65066-b179-4cca-9507-e84bd436a827]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:38 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1850400926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe1ca78-a4d4-47a8-9029-43375899bc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6daa0264e245c293c926e069b7ccc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:37Z,use_quota=True,user_id='24ef3601e4a241cdbfb2bbb3986be251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Creating volume dbe1ca78-a4d4-47a8-9029-43375899bc20 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:57:38 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:38 devstack sudo[100546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602
Jul 19 19:57:38 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:38 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 1073741824
Jul 19 19:57:38 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:38 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602" returned: 0 in 0.397s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:38 devstack sudo[100565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602
Jul 19 19:57:38 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:38 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 1073741824" returned: 0 in 0.512s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:39 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ca46f075-0da6-4eed-bb7d-e8c30bc68602" returned: 0 in 0.280s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:39 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20
Jul 19 19:57:39 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-ca46f075-0da6-4eed-bb7d-e8c30bc68602" released by "delete_volume" :: held 0.759s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Created reservations ['a2554552-b95c-4d26-8aa9-fa72c93caa42', '9dd8a842-d148-4d01-8904-50afb89e2d1c', '9bb4a42f-44b7-4c2d-a48d-1061e3d1fa47', 'a108c1cd-a3fe-471f-afc8-358944a8e12a'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:39 devstack sudo[100571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:39 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:39 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20" returned: 0 in 0.334s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Attempting download of 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab ((None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}])) to volume dbe1ca78-a4d4-47a8-9029-43375899bc20. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d00c9-f3e8-42de-9eee-6f647e231bfa]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_tdqxb_ur {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:39 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.316s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:39 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_tdqxb_ur
Jul 19 19:57:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Deleted volume successfully.
Jul 19 19:57:39 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d5d48f92-d3ad-4f10-bc66-7a77abf35326 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-ca46f075-0da6-4eed-bb7d-e8c30bc68602-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-434f7e24-3a7a-4e34-88e6-32578c4ae2b5 req-fe11c9c8-83af-468c-9c4e-21fc1ae874cd tempest-TestInstancesWithCinderVolumes-290215021 None] Terminate volume connection completed successfully.
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-434f7e24-3a7a-4e34-88e6-32578c4ae2b5 req-fe11c9c8-83af-468c-9c4e-21fc1ae874cd tempest-TestInstancesWithCinderVolumes-290215021 None] Deleting attachment 79d5aa29-0972-44de-aa12-06491a9138f9. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:57:39 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_tdqxb_ur" returned: 0 in 0.369s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_tdqxb_ur {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:39 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_tdqxb_ur
Jul 19 19:57:39 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (f7d7e3c3-7003-4002-880d-1538b205b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3aa465-eb89-4cf3-84b5-e8990918d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3aa465-eb89-4cf3-84b5-e8990918d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-465540566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2fa4e7-67a1-4a44-befb-23ffc6574ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e38fd3badf45b3afd53a09151794e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:40Z,use_quota=True,user_id='9ce5108b682b43dda52bca701d9de9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faad53dc-f857-4c30-8bc9-5e86fc28ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faad53dc-f857-4c30-8bc9-5e86fc28ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d2cf94-2e97-42e9-a41e-23dd0fe1c950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d2cf94-2e97-42e9-a41e-23dd0fe1c950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2fa4e7-67a1-4a44-befb-23ffc6574ab4', 'volume_name': 'volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e306ea-1e5d-4742-abe7-35abe83f0421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e306ea-1e5d-4742-abe7-35abe83f0421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cfa482-4a66-4bbb-a0e4-a0b0a871b450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:40 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Volume fe2fa4e7-67a1-4a44-befb-23ffc6574ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4', 'volume_size': 1}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-465540566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2fa4e7-67a1-4a44-befb-23ffc6574ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e38fd3badf45b3afd53a09151794e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:40Z,use_quota=True,user_id='9ce5108b682b43dda52bca701d9de9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Creating volume fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:57:40 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:40 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 1073741824
Jul 19 19:57:40 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:40 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_tdqxb_ur" returned: 1 in 0.351s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_tdqxb_ur' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d889db-cc28-4940-94e5-56330a1dac8c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:40 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD
Jul 19 19:57:40 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "cinder-84117ab5-f514-4f61-9eff-05e7e1386dc8-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-84117ab5-f514-4f61-9eff-05e7e1386dc8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "cinder-quobyte-84117ab5-f514-4f61-9eff-05e7e1386dc8" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-quobyte-84117ab5-f514-4f61-9eff-05e7e1386dc8" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeffa2c-a09d-4571-a6a1-04184ffb3b08]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:40 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab was qcow2, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:40 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8
Jul 19 19:57:40 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:40 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20
Jul 19 19:57:40 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:40 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 1073741824" returned: 0 in 0.494s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:40 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4
Jul 19 19:57:40 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:40 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:40 devstack sudo[100613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8
Jul 19 19:57:40 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:40 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" returned: 0 in 0.333s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:57:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cfa482-4a66-4bbb-a0e4-a0b0a871b450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6690bb38-e2bc-455c-ae8f-6a35af30795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:41 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Volume volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 (fe2fa4e7-67a1-4a44-befb-23ffc6574ab4): created successfully
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6690bb38-e2bc-455c-ae8f-6a35af30795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (f7d7e3c3-7003-4002-880d-1538b205b82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f30f9378-d76a-41d4-a84b-94948b7a10df tempest-VolumesSnapshotTestJSON-1820592518 None] Created volume successfully.
Jul 19 19:57:41 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-84117ab5-f514-4f61-9eff-05e7e1386dc8" returned: 0 in 0.358s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-quobyte-84117ab5-f514-4f61-9eff-05e7e1386dc8" released by "delete_volume" :: held 0.825s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:41 devstack cinder-volume[87353]: WARNING cinder.quota [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1696659352-2142805457 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1696659352-2142805457, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:57:41 devstack cinder-volume[87353]: WARNING cinder.quota [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1696659352-2142805457 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1696659352-2142805457, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Created reservations ['e18122a7-7621-4841-b161-88f9f2948eff', 'ff4b313e-3c37-41fd-a2ec-138975a0d595', '3c886174-234f-4a94-9bb6-4dda6a7fbfc1', '6599f8b8-718c-4b4e-b5ea-d578c3d1f07c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:41 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:41 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:41 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Deleted volume successfully.
Jul 19 19:57:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7b45c03a-64cb-4f83-bd5a-e1c390e5e323 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-84117ab5-f514-4f61-9eff-05e7e1386dc8-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Creating offline snapshot 17668dec-bb62-476f-9fb5-0aebdec61a10 of volume fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bab77fb-433f-4db5-aae7-2daeefdfa98c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:42 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20" returned: 0 in 1.970s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_xth7b3bfdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:57:42 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Converted 112.00 MB image at 56.81 MB/s
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:42 devstack sudo[100626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4
Jul 19 19:57:42 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:42 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 1G
Jul 19 19:57:42 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:42 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" returned: 0 in 0.404s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:42 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 1G
Jul 19 19:57:42 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:42 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 1G" returned: 0 in 0.364s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Downloaded image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab ((None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}])) to volume dbe1ca78-a4d4-47a8-9029-43375899bc20 successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Temporary image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab for user 24ef3601e4a241cdbfb2bbb3986be251 is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Marking volume dbe1ca78-a4d4-47a8-9029-43375899bc20 as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Copying metadata from image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab to dbe1ca78-a4d4-47a8-9029-43375899bc20. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Creating volume glance metadata for volume dbe1ca78-a4d4-47a8-9029-43375899bc20 backed by image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1ba30e-461b-4d7c-8bb6-3b8b6132ea98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe1ca78-a4d4-47a8-9029-43375899bc20', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb1730>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4b60cd-8608-43f6-8790-98cb2d785066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:42 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Volume volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 (dbe1ca78-a4d4-47a8-9029-43375899bc20): created successfully
Jul 19 19:57:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4b60cd-8608-43f6-8790-98cb2d785066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Flow 'volume_create_manager' (d0f7def4-ff59-4857-a72f-14ca95a4234b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:43 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-28e76ce8-5709-4803-8d01-23d95274ded8 tempest-VolumesImageMetadata-2118274412 None] Created volume successfully.
Jul 19 19:57:43 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 1G" returned: 0 in 0.494s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:43 devstack sudo[100658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10
Jul 19 19:57:43 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Acquiring lock "cinder-dbe1ca78-a4d4-47a8-9029-43375899bc20-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Lock "cinder-dbe1ca78-a4d4-47a8-9029-43375899bc20-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:43 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10" returned: 0 in 0.333s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:43 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 is being set with open permissions: ugo+rw
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:43 devstack sudo[100669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10
Jul 19 19:57:43 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Acquiring lock "cinder-quobyte-dbe1ca78-a4d4-47a8-9029-43375899bc20" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Lock "cinder-quobyte-dbe1ca78-a4d4-47a8-9029-43375899bc20" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f522ae80-8903-4733-92a6-d439415dbd84]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:43 devstack sudo[100672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20
Jul 19 19:57:43 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:43 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:44 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.info
Jul 19 19:57:44 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:44 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20" returned: 0 in 0.408s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:44 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20
Jul 19 19:57:44 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:44 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.info" returned: 0 in 0.288s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:44 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.info is being set with open permissions: ugo+rw
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:44 devstack sudo[100687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.info
Jul 19 19:57:44 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-fe05f44e-1f97-4cfb-a819-5560b8096d2e req-8f919657-cae5-46b7-8e62-e3eb6ca17cd2 tempest-TestInstancesWithCinderVolumes-290215021 None] Terminate volume connection completed successfully.
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-fe05f44e-1f97-4cfb-a819-5560b8096d2e req-8f919657-cae5-46b7-8e62-e3eb6ca17cd2 tempest-TestInstancesWithCinderVolumes-290215021 None] Deleting attachment 1c7c65ac-8b67-429b-8e58-9a420f12398b. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:57:44 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbe1ca78-a4d4-47a8-9029-43375899bc20" returned: 0 in 0.270s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Lock "cinder-quobyte-dbe1ca78-a4d4-47a8-9029-43375899bc20" released by "delete_volume" :: held 0.727s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Created reservations ['d929144c-a923-4a5f-8f7c-838d54b514ef', '7db6db94-14b5-4896-8ad6-5854c7368020', 'f3dec3ca-b199-4952-a08a-cfdd944fe404', '21fb425c-b25d-46de-b34e-e4504afe1104'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:44 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.info" returned: 0 in 0.309s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:44 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:44 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-bc32adde-44e1-490c-b7a1-7335a7348fee tempest-VolumesSnapshotTestJSON-1820592518 None] Create snapshot completed successfully
Jul 19 19:57:44 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Deleted volume successfully.
Jul 19 19:57:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-58160caa-6b4c-48a0-8c03-2cf38f6cb634 tempest-VolumesImageMetadata-2118274412 None] Lock "cinder-dbe1ca78-a4d4-47a8-9029-43375899bc20-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "cinder-41bd5a52-24b9-4795-821d-1d2565184bc5-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-41bd5a52-24b9-4795-821d-1d2565184bc5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "cinder-quobyte-41bd5a52-24b9-4795-821d-1d2565184bc5" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-quobyte-41bd5a52-24b9-4795-821d-1d2565184bc5" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d8c22e-1a15-4dcd-99d5-0aa2788d9791]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:45 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5
Jul 19 19:57:45 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:45 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5" returned: 0 in 0.552s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:45 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5
Jul 19 19:57:45 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:46 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-41bd5a52-24b9-4795-821d-1d2565184bc5" returned: 0 in 0.405s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-quobyte-41bd5a52-24b9-4795-821d-1d2565184bc5" released by "delete_volume" :: held 1.018s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:46 devstack cinder-volume[87353]: WARNING cinder.quota [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-923174475-1165945659 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-923174475-1165945659, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:57:46 devstack cinder-volume[87353]: WARNING cinder.quota [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-923174475-1165945659 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-923174475-1165945659, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Created reservations ['fb793bc1-5a23-4b7c-946d-1d04c8c5f30c', 'fbebbafc-6528-40a9-99db-bd09bed4b54d', '46c7fb7c-44a2-4cd3-b9c9-e5711d380a52', '40673b9d-e4f2-41db-b108-4b4c82b73d02'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (9d492dd4-41ef-40c1-b278-63a068629a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411c8828-cfd3-4e67-81fc-1fea63c36069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411c8828-cfd3-4e67-81fc-1fea63c36069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-273726193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59c3ff1-7973-4f91-848e-f6153397e76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e38fd3badf45b3afd53a09151794e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17668dec-bb62-476f-9fb5-0aebdec61a10,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:46Z,use_quota=True,user_id='9ce5108b682b43dda52bca701d9de9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b467a8fd-94ab-46ba-8bdd-df5a32121aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b467a8fd-94ab-46ba-8bdd-df5a32121aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbb9844-eaa9-49e5-a238-70d76f659b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbb9844-eaa9-49e5-a238-70d76f659b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b59c3ff1-7973-4f91-848e-f6153397e76a', 'volume_name': 'volume-b59c3ff1-7973-4f91-848e-f6153397e76a', 'volume_size': 1, 'snapshot_id': '17668dec-bb62-476f-9fb5-0aebdec61a10'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f69222-aa05-4ebc-9bc9-bea5c5b5b7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f69222-aa05-4ebc-9bc9-bea5c5b5b7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f9b11d-e625-4c40-99b6-8e3be8569019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Volume b59c3ff1-7973-4f91-848e-f6153397e76a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b59c3ff1-7973-4f91-848e-f6153397e76a', 'volume_size': 1, 'snapshot_id': '17668dec-bb62-476f-9fb5-0aebdec61a10'}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-17668dec-bb62-476f-9fb5-0aebdec61a10-b59c3ff1-7973-4f91-848e-f6153397e76a" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-17668dec-bb62-476f-9fb5-0aebdec61a10-b59c3ff1-7973-4f91-848e-f6153397e76a" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Creating volume b59c3ff1-7973-4f91-848e-f6153397e76a from snapshot 17668dec-bb62-476f-9fb5-0aebdec61a10 {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-b59c3ff1-7973-4f91-848e-f6153397e76a" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-b59c3ff1-7973-4f91-848e-f6153397e76a" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] snapshot: 17668dec-bb62-476f-9fb5-0aebdec61a10, volume: b59c3ff1-7973-4f91-848e-f6153397e76a,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 19:57:46 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:46 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[43985b7a-069f-4f86-9a6f-7dc5e326cd7c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:46 devstack sudo[100706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10
Jul 19 19:57:46 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:46 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.410s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:46 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Deleted volume successfully.
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1034baad-7559-4f79-a772-17ddb118eebb tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-41bd5a52-24b9-4795-821d-1d2565184bc5-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:47 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10" returned: 0 in 0.500s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e397bb9e-6334-406d-9f4c-dcf073e3e1ab]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:47 devstack sudo[100714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4
Jul 19 19:57:47 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:47 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" returned: 0 in 0.455s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 19:57:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:47 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a
Jul 19 19:57:47 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-daf22e02-9aa3-4d9e-b0e1-a6559dc496a1 req-0ebff714-da95-43bf-a673-1f330af95a36 tempest-TestInstancesWithCinderVolumes-290215021 None] Terminate volume connection completed successfully.
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-daf22e02-9aa3-4d9e-b0e1-a6559dc496a1 req-0ebff714-da95-43bf-a673-1f330af95a36 tempest-TestInstancesWithCinderVolumes-290215021 None] Deleting attachment 8745e2a2-35ce-475e-98ce-d6cb8ce11a83. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Flow 'volume_create_manager' (f029802f-cc24-40e3-bb33-d1970051d9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee137f38-67c3-4c5d-a316-da84c826062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee137f38-67c3-4c5d-a316-da84c826062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-358559881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9623a244-b841-489a-b902-006f0f724a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac89ca6035b74f55923f56cd2d9b02e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:52Z,use_quota=True,user_id='f933e917e50d4ddc851ba4c3a242d36b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52a412c-a337-459e-a25f-cbec7d9b1f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52a412c-a337-459e-a25f-cbec7d9b1f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a975c0d-a062-4db0-9127-5cb98c904cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a975c0d-a062-4db0-9127-5cb98c904cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9623a244-b841-489a-b902-006f0f724a24', 'volume_name': 'volume-9623a244-b841-489a-b902-006f0f724a24', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9dbe66-8c61-4cb7-8fa2-6c43c0b8a141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9dbe66-8c61-4cb7-8fa2-6c43c0b8a141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af30b513-45c5-4e43-87dd-6f4bdf8fa597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:52 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Volume 9623a244-b841-489a-b902-006f0f724a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9623a244-b841-489a-b902-006f0f724a24', 'volume_size': 1}
Jul 19 19:57:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:53 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a" returned: 0 in 5.947s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:53 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[941a3a42-d438-4cd7-841b-ac58be6324e6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:53 devstack sudo[100757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4
Jul 19 19:57:53 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "cinder-63340f06-b17c-4d27-8bff-207dec1721f3-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-63340f06-b17c-4d27-8bff-207dec1721f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=128,cinder:SELECT=119,cinder:INSERT=32,cinder:DELETE=6 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=117,cinder:DELETE=15,cinder:SELECT=128,cinder:INSERT=39 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "cinder-quobyte-63340f06-b17c-4d27-8bff-207dec1721f3" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-quobyte-63340f06-b17c-4d27-8bff-207dec1721f3" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04870ce-8c15-42ea-9afc-e6eeb86a332a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:54 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" returned: 0 in 0.553s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:57:54 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Converted 1024.00 MB image at 172.14 MB/s
Jul 19 19:57:54 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a is being set with open permissions: ugo+rw
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:54 devstack sudo[100764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a
Jul 19 19:57:54 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:54 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3
Jul 19 19:57:54 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:54 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a" returned: 0 in 0.268s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-b59c3ff1-7973-4f91-848e-f6153397e76a" released by "_copy_volume_from_snapshot" :: held 7.880s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-17668dec-bb62-476f-9fb5-0aebdec61a10-b59c3ff1-7973-4f91-848e-f6153397e76a" released by "_create_volume_from_snapshot" :: held 7.941s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.969s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.457s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-358559881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9623a244-b841-489a-b902-006f0f724a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac89ca6035b74f55923f56cd2d9b02e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:57:52Z,use_quota=True,user_id='f933e917e50d4ddc851ba4c3a242d36b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Creating volume 9623a244-b841-489a-b902-006f0f724a24 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:57:54 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:54 devstack sudo[100771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24 1073741824
Jul 19 19:57:54 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f9b11d-e625-4c40-99b6-8e3be8569019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59c3ff1-7973-4f91-848e-f6153397e76a', 'volume_size': 1, 'snapshot_id': '17668dec-bb62-476f-9fb5-0aebdec61a10'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5450b857-0ab9-4742-b42f-8b2dacf274f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:54 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:54 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Volume volume-b59c3ff1-7973-4f91-848e-f6153397e76a (b59c3ff1-7973-4f91-848e-f6153397e76a): created successfully
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5450b857-0ab9-4742-b42f-8b2dacf274f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Flow 'volume_create_manager' (9d492dd4-41ef-40c1-b278-63a068629a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3" returned: 0 in 0.399s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:54 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3
Jul 19 19:57:54 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:54 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-564ec053-62e7-412c-8bd3-a7be1797877a tempest-VolumesSnapshotTestJSON-1820592518 None] Created volume successfully.
Jul 19 19:57:54 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-63340f06-b17c-4d27-8bff-207dec1721f3" returned: 0 in 0.275s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-quobyte-63340f06-b17c-4d27-8bff-207dec1721f3" released by "delete_volume" :: held 0.724s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:54 devstack cinder-volume[87353]: WARNING cinder.quota [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1289374521-1284131806 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1289374521-1284131806, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:57:54 devstack cinder-volume[87353]: WARNING cinder.quota [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1289374521-1284131806 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1289374521-1284131806, it is now deprecated. Please use the default quota class for default quota.
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Created reservations ['2bd78d11-5e90-4cd0-8fea-b2953929720e', '09c17075-199e-4493-97be-9169c52691a2', '2adc628d-4e61-48e2-b380-b3507b801c0d', 'f78a9e92-287a-4068-97b3-21f6f7797723'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:54 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24 1073741824" returned: 0 in 0.469s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:55 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24
Jul 19 19:57:55 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:55 devstack sudo[100782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:55 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:55 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24" returned: 0 in 0.261s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af30b513-45c5-4e43-87dd-6f4bdf8fa597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9623a244-b841-489a-b902-006f0f724a24', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571374d3-de15-45c7-b555-6c3e35ab1507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:57:55 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Volume volume-9623a244-b841-489a-b902-006f0f724a24 (9623a244-b841-489a-b902-006f0f724a24): created successfully
Jul 19 19:57:55 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571374d3-de15-45c7-b555-6c3e35ab1507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Flow 'volume_create_manager' (f029802f-cc24-40e3-bb33-d1970051d9b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.276s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:55 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Deleted volume successfully.
Jul 19 19:57:55 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-aa8e29b3-524f-4b35-8ab1-dbc4e37688d9 tempest-AbsoluteLimitsTests-625655835 None] Created volume successfully.
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1c63b2db-c7bc-442b-b6e1-571595836491 tempest-TestInstancesWithCinderVolumes-290215021 None] Lock "cinder-63340f06-b17c-4d27-8bff-207dec1721f3-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-b59c3ff1-7973-4f91-848e-f6153397e76a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-b59c3ff1-7973-4f91-848e-f6153397e76a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-b59c3ff1-7973-4f91-848e-f6153397e76a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-b59c3ff1-7973-4f91-848e-f6153397e76a" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[87968628-32d1-420a-9866-28bd73bfdda0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:55 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a
Jul 19 19:57:55 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:56 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Acquiring lock "cinder-9623a244-b841-489a-b902-006f0f724a24-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a" returned: 0 in 0.414s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Lock "cinder-9623a244-b841-489a-b902-006f0f724a24-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:56 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a
Jul 19 19:57:56 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Acquiring lock "cinder-quobyte-9623a244-b841-489a-b902-006f0f724a24" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Lock "cinder-quobyte-9623a244-b841-489a-b902-006f0f724a24" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[12043eb0-39e6-41ee-be25-37ff97e0d40f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:56 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24
Jul 19 19:57:56 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:56 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b59c3ff1-7973-4f91-848e-f6153397e76a" returned: 0 in 0.308s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-b59c3ff1-7973-4f91-848e-f6153397e76a" released by "delete_volume" :: held 0.769s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Created reservations ['58738170-60bd-4fc1-be4f-56a9c2839329', '634abda8-35fa-4f3c-85e9-61b27c1eeeec', 'cb401e66-d13d-44f0-a735-d780f75bc22f', '42733dfb-1785-4356-9c03-8c605d97cd4e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:56 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:56 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:56 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24" returned: 0 in 0.382s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:56 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24
Jul 19 19:57:56 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-17668dec-bb62-476f-9fb5-0aebdec61a10-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-17668dec-bb62-476f-9fb5-0aebdec61a10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:56 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-17668dec-bb62-476f-9fb5-0aebdec61a10" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.335s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Deleted volume successfully.
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-17668dec-bb62-476f-9fb5-0aebdec61a10" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Deleting offline snapshot 17668dec-bb62-476f-9fb5-0aebdec61a10 of volume fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:57:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] snapshot_file for this snap is: volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc8c8cc-66bb-4713-9bbf-b3b65af6cc79]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:57 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9623a244-b841-489a-b902-006f0f724a24" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ca1a85e8-04d8-4721-a78c-07ef15960f19 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-b59c3ff1-7973-4f91-848e-f6153397e76a-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Lock "cinder-quobyte-9623a244-b841-489a-b902-006f0f724a24" released by "delete_volume" :: held 0.780s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Created reservations ['eb53dba4-15c4-4ec7-83fa-505ebf9805a8', 'b2c013ff-7aeb-427f-bff4-2ab01cc7288e', 'e5d7fc32-de31-4307-a666-24a52b22a2b4', '0b496d31-fa44-4c0d-9073-186497e3f332'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:57 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10
Jul 19 19:57:57 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:57 devstack sudo[100807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:57:57 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:57 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10" returned: 0 in 0.448s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fe807c-7232-4c29-b96e-2be267e4f5e6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:57 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.336s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:57:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Deleted volume successfully.
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f8244d22-8001-4ed4-ae62-8066aedf7d46 tempest-AbsoluteLimitsTests-625655835 None] Lock "cinder-9623a244-b841-489a-b902-006f0f724a24-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:57 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4
Jul 19 19:57:57 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:57 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" returned: 0 in 0.449s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:57 devstack sudo[100820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10
Jul 19 19:57:57 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:58 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10" returned: 0 in 0.398s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:58 devstack sudo[100826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10
Jul 19 19:57:58 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:58 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4.17668dec-bb62-476f-9fb5-0aebdec61a10" returned: 0 in 0.325s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-17668dec-bb62-476f-9fb5-0aebdec61a10" released by "_delete_snapshot" :: held 1.755s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" released by "delete_snapshot" :: held 1.783s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:58 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Created reservations ['b3610a22-1c3c-4788-9abf-27667639a86c', 'c14462e0-4eec-45ef-b72a-b44013c1080b', 'a503157d-05e5-41cf-a836-22f961cc705d', '3d5153fb-6c1c-49d3-9967-1242fb6a609d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:57:58 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Delete snapshot completed successfully.
Jul 19 19:57:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bea74e13-a816-4299-9e2c-2edd9c664587 tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-17668dec-bb62-476f-9fb5-0aebdec61a10-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:57:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:57:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:57:59 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00eebe0-2aff-4f62-b139-d5ccfe924733]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:57:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:59 devstack sudo[100829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4
Jul 19 19:57:59 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:57:59 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root
Jul 19 19:57:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" returned: 0 in 0.455s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:57:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:57:59 devstack sudo[100834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4
Jul 19 19:57:59 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:00 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4" released by "delete_volume" :: held 0.967s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Created reservations ['5cd40fb8-7e2b-4a79-943e-93a481c43c98', 'c0047bda-88d0-4005-b043-17b5b3f106fb', '71a2832b-7da7-47ae-aa50-f198d83b2d01', '362ba41e-8c70-4cb3-abb7-13ade4fdd62f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:00 devstack sudo[100838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:58:00 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:00 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.265s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:58:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Deleted volume successfully.
Jul 19 19:58:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7d0275e-7069-464c-89dc-e168921f57af tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-fe2fa4e7-67a1-4a44-befb-23ffc6574ab4-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-d0ff9787-39e6-45d0-a049-c9065efe87cf-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-d0ff9787-39e6-45d0-a049-c9065efe87cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "cinder-quobyte-d0ff9787-39e6-45d0-a049-c9065efe87cf" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-d0ff9787-39e6-45d0-a049-c9065efe87cf" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:01 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1330ab-ba76-4fcc-b364-849319513f02]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:01 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf
Jul 19 19:58:01 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:02 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf" returned: 0 in 0.386s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:02 devstack sudo[100846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf
Jul 19 19:58:02 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Flow 'volume_create_manager' (20f31350-1efa-42a9-a918-bcfbb4a35774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a779322-1795-44b2-8948-adc8ce6efa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a779322-1795-44b2-8948-adc8ce6efa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-891379044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcc6b3c-31ed-4842-8b75-1d81e6618306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='413cfb7912244796b42723ec9f6fe306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:02Z,use_quota=True,user_id='be839c2eaf144b16afe6b829e3412e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdea16c4-b2aa-49d1-8723-ca883a589db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdea16c4-b2aa-49d1-8723-ca883a589db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4d4e8c-6055-4cf2-8ffb-0cab1e4cadc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4d4e8c-6055-4cf2-8ffb-0cab1e4cadc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcc6b3c-31ed-4842-8b75-1d81e6618306', 'volume_name': 'volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306', 'volume_size': 2}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5169fac1-91ed-41a7-a6c9-d65438006897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5169fac1-91ed-41a7-a6c9-d65438006897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af72419-73a0-40b5-aa96-e39301449583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Volume dbcc6b3c-31ed-4842-8b75-1d81e6618306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306', 'volume_size': 2}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-891379044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcc6b3c-31ed-4842-8b75-1d81e6618306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='413cfb7912244796b42723ec9f6fe306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:02Z,use_quota=True,user_id='be839c2eaf144b16afe6b829e3412e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Creating volume dbcc6b3c-31ed-4842-8b75-1d81e6618306 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:58:02 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306 2147483648 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:02 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d0ff9787-39e6-45d0-a049-c9065efe87cf" returned: 0 in 0.355s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:02 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306 2147483648
Jul 19 19:58:02 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-quobyte-d0ff9787-39e6-45d0-a049-c9065efe87cf" released by "delete_volume" :: held 0.842s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Created reservations ['900f612d-2995-46a8-9b08-bb766f337576', '40a25bb8-b92a-4522-a295-d5e3a5af5e61', '970d06bf-2a97-428b-bb84-ec63bfe049ea', 'b3646834-571a-4fa6-b81c-915380dd9ae9'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:02 devstack sudo[100852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:58:02 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:03 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.328s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:58:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Deleted volume successfully.
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-829df5fc-1f13-48c1-9c14-92c3db7b599a tempest-VolumesSnapshotTestJSON-1820592518 None] Lock "cinder-d0ff9787-39e6-45d0-a049-c9065efe87cf-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:03 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306 2147483648" returned: 0 in 0.607s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:03 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306
Jul 19 19:58:03 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:03 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306" returned: 0 in 0.263s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af72419-73a0-40b5-aa96-e39301449583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306', 'volume_size': 2}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c8d4ce-490d-4db5-b651-3d56a2d44815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:03 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Volume volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306 (dbcc6b3c-31ed-4842-8b75-1d81e6618306): created successfully
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c8d4ce-490d-4db5-b651-3d56a2d44815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Flow 'volume_create_manager' (20f31350-1efa-42a9-a918-bcfbb4a35774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-245cca30-c21d-4015-a29d-f0d0409e7d32 tempest-VolumesCloneNegativeTest-1480976836 None] Created volume successfully.
Jul 19 19:58:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Acquiring lock "cinder-dbcc6b3c-31ed-4842-8b75-1d81e6618306-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Lock "cinder-dbcc6b3c-31ed-4842-8b75-1d81e6618306-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Acquiring lock "cinder-quobyte-dbcc6b3c-31ed-4842-8b75-1d81e6618306" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Lock "cinder-quobyte-dbcc6b3c-31ed-4842-8b75-1d81e6618306" acquired by "delete_volume" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce8d38e-8bef-41f6-8c2a-91274656f395]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:05 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306
Jul 19 19:58:05 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:05 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:05 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306
Jul 19 19:58:05 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:05 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-dbcc6b3c-31ed-4842-8b75-1d81e6618306" returned: 0 in 0.270s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Lock "cinder-quobyte-dbcc6b3c-31ed-4842-8b75-1d81e6618306" released by "delete_volume" :: held 0.772s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Created reservations ['8479b839-f88a-4053-bc6a-2b482cf27eb5', 'be1a0e34-ab78-44b7-af40-8c9d34a28efd', '08adffb2-883f-49d8-b374-47ee8801cdf6', 'ef902df5-2ed8-4930-be83-95c7e94dc447'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:05 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:58:05 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:06 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.306s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:06 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:58:06 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Deleted volume successfully.
Jul 19 19:58:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-97320261-58bd-4e94-a852-731c4f44c49e tempest-VolumesCloneNegativeTest-1480976836 None] Lock "cinder-dbcc6b3c-31ed-4842-8b75-1d81e6618306-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Flow 'volume_create_manager' (a09b588f-3ede-4230-9013-f8e09d4d684b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c1abf9-25b1-45ae-b8bb-110e49fb003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c1abf9-25b1-45ae-b8bb-110e49fb003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-477795661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6fd120-2901-4485-96ba-d9850ce45062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c5cc9fb28f47c2919750c5593b7864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:10Z,use_quota=True,user_id='068d4f23616447b0814943a6d0e04050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aeebe7f-3f18-4692-ae38-e443e470ad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aeebe7f-3f18-4692-ae38-e443e470ad46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed17818-77c8-4a33-98d4-c8063db4a7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Flow 'volume_create_manager' (814bed60-b748-4739-b4ad-243eb9577e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ece1717-67ed-4d28-9a68-13c6ffddd368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ece1717-67ed-4d28-9a68-13c6ffddd368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1667211479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db79a285-c89f-4a44-a55e-aca6476752e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9585df0a5db4420e9b6992157c6d4578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:11Z,use_quota=True,user_id='f4a50969e8a64698a0bd50841cb7f03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d2344b-155f-40cd-96e1-79cc40462c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d2344b-155f-40cd-96e1-79cc40462c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8d7e76-787b-4861-a0e4-9a6560e0e617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8d7e76-787b-4861-a0e4-9a6560e0e617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db79a285-c89f-4a44-a55e-aca6476752e9', 'volume_name': 'volume-db79a285-c89f-4a44-a55e-aca6476752e9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a85ff2d-a3dc-4437-bb99-7f32953aee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a85ff2d-a3dc-4437-bb99-7f32953aee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacd6210-c373-4ea5-9434-05cd85da7520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Volume db79a285-c89f-4a44-a55e-aca6476752e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db79a285-c89f-4a44-a55e-aca6476752e9', 'volume_size': 1}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1667211479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db79a285-c89f-4a44-a55e-aca6476752e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9585df0a5db4420e9b6992157c6d4578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:11Z,use_quota=True,user_id='f4a50969e8a64698a0bd50841cb7f03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Creating volume db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:58:10 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:10 devstack sudo[100880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9 1073741824
Jul 19 19:58:10 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed17818-77c8-4a33-98d4-c8063db4a7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe6fd120-2901-4485-96ba-d9850ce45062', 'volume_name': 'volume-fe6fd120-2901-4485-96ba-d9850ce45062', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cada450>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8955deb-2242-4ccd-8560-ca567ecfb9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8955deb-2242-4ccd-8560-ca567ecfb9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0b71a0-5c85-42d6-8e92-f8e4d0e73d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:10 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Volume fe6fd120-2901-4485-96ba-d9850ce45062: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe6fd120-2901-4485-96ba-d9850ce45062', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cada450>}
Jul 19 19:58:10 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Trying to clone fe6fd120-2901-4485-96ba-d9850ce45062 from image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab at location (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 19:58:11 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Image download 20.69 MB at 20.69 MB/s
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f9937d-1e62-4069-b619-1aca794613cf]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:11 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9 1073741824" returned: 0 in 0.603s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:11 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9
Jul 19 19:58:11 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:11 devstack sudo[100887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD
Jul 19 19:58:11 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:11 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9" returned: 0 in 0.272s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:11 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Temporary image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab is fetched for user 068d4f23616447b0814943a6d0e04050. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacd6210-c373-4ea5-9434-05cd85da7520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db79a285-c89f-4a44-a55e-aca6476752e9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8664ae44-ba53-4fa0-af94-e09b66d1285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:11 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Volume volume-db79a285-c89f-4a44-a55e-aca6476752e9 (db79a285-c89f-4a44-a55e-aca6476752e9): created successfully
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8664ae44-ba53-4fa0-af94-e09b66d1285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Flow 'volume_create_manager' (814bed60-b748-4739-b4ad-243eb9577e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-64dc56af-4830-4654-8bf6-7dde4c71601d tempest-VolumesSnapshotListTestJSON-1125965625 None] Created volume successfully.
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a2f41d-9fa8-465c-8291-44d10a923a1b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:11 devstack sudo[100895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD
Jul 19 19:58:11 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:12 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-477795661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6fd120-2901-4485-96ba-d9850ce45062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c5cc9fb28f47c2919750c5593b7864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:10Z,use_quota=True,user_id='068d4f23616447b0814943a6d0e04050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Creating volume fe6fd120-2901-4485-96ba-d9850ce45062 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:58:12 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:12 devstack sudo[100900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 1073741824
Jul 19 19:58:12 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:12 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 1073741824" returned: 0 in 0.516s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:12 devstack sudo[100906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062
Jul 19 19:58:12 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:13 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062" returned: 0 in 0.286s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.364s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Creating offline snapshot 2bb3a453-584d-46dd-be98-c8dc9571e3bd of volume db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Attempting download of 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab ((None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}])) to volume fe6fd120-2901-4485-96ba-d9850ce45062. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4b7afb-35cc-4d70-b8c9-888faff27a80]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb64bf6-c281-4cc1-a717-eebe5d9fd554]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_2htuzzyz {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:13 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9
Jul 19 19:58:13 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:13 devstack sudo[100910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_2htuzzyz
Jul 19 19:58:13 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:13 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_2htuzzyz" returned: 0 in 0.346s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_2htuzzyz {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:13 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9" returned: 0 in 0.412s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:13 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd 1G
Jul 19 19:58:13 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:13 devstack sudo[100918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_2htuzzyz
Jul 19 19:58:13 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:13 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_2htuzzyz" returned: 1 in 0.366s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_2htuzzyz' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a3c4da-ce26-49ba-bcc8-9e85505889e3]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:13 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd 1G" returned: 0 in 0.420s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:13 devstack sudo[100930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd
Jul 19 19:58:13 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:13 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD
Jul 19 19:58:13 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:14 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:14 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab was qcow2, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 19:58:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:14 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd" returned: 0 in 0.473s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:14 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd is being set with open permissions: ugo+rw
Jul 19 19:58:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:14 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062
Jul 19 19:58:14 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:14 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd
Jul 19 19:58:14 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:14 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd" returned: 0 in 0.300s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:14 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.info
Jul 19 19:58:14 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:15 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.info" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:15 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.info is being set with open permissions: ugo+rw
Jul 19 19:58:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:15 devstack sudo[100957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.info
Jul 19 19:58:15 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:15 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.info" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-80195824-0559-443f-8ca1-b1254523e5a5 tempest-VolumesSnapshotListTestJSON-1125965625 None] Create snapshot completed successfully
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Creating offline snapshot af5246d9-7804-4b55-900b-5e6789ae0c7c of volume db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761b170-06b4-452d-bf89-4a5e02c95029]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:16 devstack sudo[100960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd
Jul 19 19:58:16 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:16 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062" returned: 0 in 1.953s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_lk3dm2bidevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:58:16 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Converted 112.00 MB image at 57.30 MB/s
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:16 devstack sudo[100962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 1G
Jul 19 19:58:16 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:16 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd" returned: 0 in 0.479s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db79a285-c89f-4a44-a55e-aca6476752e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:16 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c 1G
Jul 19 19:58:16 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:16 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 1G" returned: 0 in 0.460s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Downloaded image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab ((None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}])) to volume fe6fd120-2901-4485-96ba-d9850ce45062 successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Temporary image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab for user 068d4f23616447b0814943a6d0e04050 is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Marking volume fe6fd120-2901-4485-96ba-d9850ce45062 as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Copying metadata from image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab to fe6fd120-2901-4485-96ba-d9850ce45062. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Creating volume glance metadata for volume fe6fd120-2901-4485-96ba-d9850ce45062 backed by image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0b71a0-5c85-42d6-8e92-f8e4d0e73d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6fd120-2901-4485-96ba-d9850ce45062', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cada450>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cb1dd7-0fd9-4c72-812f-f473b2fc09fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:16 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Volume volume-fe6fd120-2901-4485-96ba-d9850ce45062 (fe6fd120-2901-4485-96ba-d9850ce45062): created successfully
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cb1dd7-0fd9-4c72-812f-f473b2fc09fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Flow 'volume_create_manager' (a09b588f-3ede-4230-9013-f8e09d4d684b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:16 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8abb7ef3-3fc4-47e2-b2e8-1415b891f3a2 tempest-VolumesExtendTest-2060175697 None] Created volume successfully.
Jul 19 19:58:17 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c 1G" returned: 0 in 0.520s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:17 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c
Jul 19 19:58:17 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:17 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c" returned: 0 in 0.318s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:17 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c is being set with open permissions: ugo+rw
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:17 devstack sudo[100983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c
Jul 19 19:58:17 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ec2f013b-05e8-4828-8d04-ff1c1a802681 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:17 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c" returned: 0 in 0.277s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.725s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ec2f013b-05e8-4828-8d04-ff1c1a802681 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.055s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbdcf0a-6dc3-4fc4-8b53-214ea36a6cba]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ec2f013b-05e8-4828-8d04-ff1c1a802681 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ed8f1f8b-0cc3-4a0d-a728-65d7272cce0c tempest-VolumesSnapshotListTestJSON-1125965625 None] Create snapshot completed successfully
Jul 19 19:58:17 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062
Jul 19 19:58:17 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:18 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ec2f013b-05e8-4828-8d04-ff1c1a802681 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062" returned: 0 in 0.385s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ec2f013b-05e8-4828-8d04-ff1c1a802681 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 2G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ec2f013b-05e8-4828-8d04-ff1c1a802681 tempest-VolumesExtendTest-2060175697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 2G" returned: 0 in 0.149s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ec2f013b-05e8-4828-8d04-ff1c1a802681 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.561s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Creating offline snapshot 1c087381-d955-4cd1-9ace-1be58785b7e9 of volume db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f06a6a8-23c7-4f8c-b97e-ebc842c30720]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:18 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ec2f013b-05e8-4828-8d04-ff1c1a802681 tempest-VolumesExtendTest-2060175697 None] Extend volume completed successfully.
Jul 19 19:58:18 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c
Jul 19 19:58:18 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:18 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c" returned: 0 in 0.437s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db79a285-c89f-4a44-a55e-aca6476752e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:18 devstack sudo[100999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 1G
Jul 19 19:58:18 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "cinder-fe6fd120-2901-4485-96ba-d9850ce45062-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-fe6fd120-2901-4485-96ba-d9850ce45062-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "cinder-quobyte-fe6fd120-2901-4485-96ba-d9850ce45062" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-quobyte-fe6fd120-2901-4485-96ba-d9850ce45062" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a748ac6-f687-4803-b527-34123f1508c4]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:19 devstack sudo[101004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062
Jul 19 19:58:19 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:19 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 1G" returned: 0 in 0.662s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:19 devstack sudo[101007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9
Jul 19 19:58:19 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:19 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062" returned: 0 in 0.459s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:19 devstack sudo[101012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062
Jul 19 19:58:19 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:20 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9" returned: 0 in 0.444s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:20 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 is being set with open permissions: ugo+rw
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:20 devstack sudo[101018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9
Jul 19 19:58:20 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:20 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe6fd120-2901-4485-96ba-d9850ce45062" returned: 0 in 0.371s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-quobyte-fe6fd120-2901-4485-96ba-d9850ce45062" released by "delete_volume" :: held 0.896s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Created reservations ['9b3054e7-596c-47ee-9511-a84f62a57dce', '4b88aa5a-3f9a-4bcc-9d25-aa3b2fde443f', 'd84409a4-af45-4607-85e2-b4cb4e0d083c', '673e660c-a4eb-41d5-8033-a9c5c169378e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:20 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9" returned: 0 in 0.304s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:20 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ddca87b7-b6d0-459a-8600-80da02fbf4ac tempest-VolumesSnapshotListTestJSON-1125965625 None] Create snapshot completed successfully
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:20 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:58:20 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:20 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:58:20 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Deleted volume successfully.
Jul 19 19:58:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fa094efd-cbcf-4011-9c46-83c097a0fc55 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-fe6fd120-2901-4485-96ba-d9850ce45062-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Flow 'volume_create_manager' (ae895ffb-1c40-4410-8414-67bf16580791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f11d8a-1b6f-4675-a548-ddc52de8cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f11d8a-1b6f-4675-a548-ddc52de8cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-712623641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b094774-76a1-4ef9-8c0a-3655ee7c8d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c5cc9fb28f47c2919750c5593b7864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:21Z,use_quota=True,user_id='068d4f23616447b0814943a6d0e04050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dedf6f-cc46-4a5b-b57d-bd529df53434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dedf6f-cc46-4a5b-b57d-bd529df53434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63616e61-4d70-466d-93f0-5179be6ef024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63616e61-4d70-466d-93f0-5179be6ef024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b094774-76a1-4ef9-8c0a-3655ee7c8d73', 'volume_name': 'volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07434e81-76c0-4bf6-a404-881e60b37b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07434e81-76c0-4bf6-a404-881e60b37b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786d828f-f75d-4674-a914-bbfc8a4d5246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:21 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Volume 6b094774-76a1-4ef9-8c0a-3655ee7c8d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73', 'volume_size': 1}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-712623641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b094774-76a1-4ef9-8c0a-3655ee7c8d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c5cc9fb28f47c2919750c5593b7864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:21Z,use_quota=True,user_id='068d4f23616447b0814943a6d0e04050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Creating volume 6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:58:21 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:21 devstack sudo[101059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 1073741824
Jul 19 19:58:21 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-1c087381-d955-4cd1-9ace-1be58785b7e9-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-1c087381-d955-4cd1-9ace-1be58785b7e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-quobyte-1c087381-d955-4cd1-9ace-1be58785b7e9" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:21 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-1c087381-d955-4cd1-9ace-1be58785b7e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Deleting offline snapshot 1c087381-d955-4cd1-9ace-1be58785b7e9 of volume db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] snapshot_file for this snap is: volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 1073741824" returned: 0 in 0.613s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2654262e-4497-4c60-8087-64fc94e89bcd]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:21 devstack sudo[101068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73
Jul 19 19:58:21 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:21 devstack sudo[101067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9
Jul 19 19:58:21 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:22 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" returned: 0 in 0.281s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786d828f-f75d-4674-a914-bbfc8a4d5246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68884e97-4bd4-423a-97fd-66625c352d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:22 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Volume volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 (6b094774-76a1-4ef9-8c0a-3655ee7c8d73): created successfully
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68884e97-4bd4-423a-97fd-66625c352d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Flow 'volume_create_manager' (ae895ffb-1c40-4410-8414-67bf16580791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0ea41bad-951e-40d8-b727-fc99a1561a56 tempest-VolumesExtendTest-2060175697 None] Created volume successfully.
Jul 19 19:58:22 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9" returned: 0 in 0.445s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db79a285-c89f-4a44-a55e-aca6476752e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f300c4-7ac1-4deb-a7df-59c3daee0f16]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:22 devstack sudo[101075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c
Jul 19 19:58:22 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:22 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c" returned: 0 in 0.351s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db79a285-c89f-4a44-a55e-aca6476752e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:22 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9
Jul 19 19:58:22 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:23 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9" returned: 0 in 0.496s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:23 devstack sudo[101085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9
Jul 19 19:58:23 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Creating offline snapshot 659a5ebe-1011-4bd8-a575-d14d6019555d of volume 6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb18f8ce-4a30-4778-9450-0ff7ea233039]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:23 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.1c087381-d955-4cd1-9ace-1be58785b7e9" returned: 0 in 0.310s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-1c087381-d955-4cd1-9ace-1be58785b7e9" released by "_delete_snapshot" :: held 1.711s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" released by "delete_snapshot" :: held 1.741s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:23 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73
Jul 19 19:58:23 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Created reservations ['d7516068-41da-443d-9bda-7deff350e654', 'cd744585-8fcb-4a37-a72f-03649ef2ec7b', 'a7a328c1-152b-46ce-a1a1-58d6fbefd614', 'd9974a7f-4fa0-4e94-b73e-fc94a0b0f78c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Delete snapshot completed successfully.
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-92a1f030-fdab-462a-b232-07d8f749f5dc tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-1c087381-d955-4cd1-9ace-1be58785b7e9-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:23 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" returned: 0 in 0.387s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:23 devstack sudo[101095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d 1G
Jul 19 19:58:23 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-af5246d9-7804-4b55-900b-5e6789ae0c7c-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-af5246d9-7804-4b55-900b-5e6789ae0c7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-quobyte-af5246d9-7804-4b55-900b-5e6789ae0c7c" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-af5246d9-7804-4b55-900b-5e6789ae0c7c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Deleting offline snapshot af5246d9-7804-4b55-900b-5e6789ae0c7c of volume db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] snapshot_file for this snap is: volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0b9fdc-b057-4d4b-895b-61f18be7cf88]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:24 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c
Jul 19 19:58:24 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:24 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d 1G" returned: 0 in 0.526s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:24 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d
Jul 19 19:58:24 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:24 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c" returned: 0 in 0.450s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db79a285-c89f-4a44-a55e-aca6476752e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceccc5c-6402-47dc-8f1e-f7aa2f7a2600]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:24 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd
Jul 19 19:58:24 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:24 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d" returned: 0 in 0.341s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:24 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d is being set with open permissions: ugo+rw
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:24 devstack sudo[101114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d
Jul 19 19:58:24 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:24 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd" returned: 0 in 0.410s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db79a285-c89f-4a44-a55e-aca6476752e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:24 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c
Jul 19 19:58:24 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:24 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d" returned: 0 in 0.277s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:25 devstack sudo[101122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.info
Jul 19 19:58:25 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:25 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.info" returned: 0 in 0.319s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:25 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.info is being set with open permissions: ugo+rw
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:25 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:25 devstack sudo[101129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.info
Jul 19 19:58:25 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c" returned: 0 in 0.461s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:25 devstack sudo[101131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c
Jul 19 19:58:25 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:25 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.info" returned: 0 in 0.285s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:25 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.af5246d9-7804-4b55-900b-5e6789ae0c7c" returned: 0 in 0.273s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-af5246d9-7804-4b55-900b-5e6789ae0c7c" released by "_delete_snapshot" :: held 1.709s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" released by "delete_snapshot" :: held 1.739s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7d525d8e-5aea-4965-9b8e-9a44638604fb tempest-VolumesExtendTest-2060175697 None] Create snapshot completed successfully
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Created reservations ['30906a25-cde9-462a-83d2-3340968cb863', '4e0e2402-c307-4165-a444-57d87b26e364', 'de098bcd-a7ab-40a6-9db8-043aca6a5a39', 'ed11d563-595a-4ebc-9d50-08ce24c3393e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Delete snapshot completed successfully.
Jul 19 19:58:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-10b4fc03-cdc9-447f-be1c-bd8fd4b3f724 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-af5246d9-7804-4b55-900b-5e6789ae0c7c-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-2bb3a453-584d-46dd-be98-c8dc9571e3bd-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-2bb3a453-584d-46dd-be98-c8dc9571e3bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-quobyte-2bb3a453-584d-46dd-be98-c8dc9571e3bd" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-2bb3a453-584d-46dd-be98-c8dc9571e3bd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Deleting offline snapshot 2bb3a453-584d-46dd-be98-c8dc9571e3bd of volume db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] snapshot_file for this snap is: volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cfc195-1e75-4452-ad0c-3fda6dd8463d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:26 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd
Jul 19 19:58:26 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:26 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd" returned: 0 in 0.430s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db79a285-c89f-4a44-a55e-aca6476752e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1523623-0a9f-4e15-b478-40b1efb8e7b8]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98178ab8-8267-4a33-bfa7-fd382bc4e504 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98178ab8-8267-4a33-bfa7-fd382bc4e504 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ee8ebe-148c-497e-92ba-3f4af88f23e7]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98178ab8-8267-4a33-bfa7-fd382bc4e504 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:26 devstack sudo[101141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9
Jul 19 19:58:26 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:26 devstack sudo[101142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73
Jul 19 19:58:26 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:27 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9" returned: 0 in 0.428s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:27 devstack sudo[101148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd
Jul 19 19:58:27 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:27 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98178ab8-8267-4a33-bfa7-fd382bc4e504 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" returned: 0 in 0.462s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98178ab8-8267-4a33-bfa7-fd382bc4e504 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d 2G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98178ab8-8267-4a33-bfa7-fd382bc4e504 tempest-VolumesExtendTest-2060175697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d 2G" returned: 0 in 0.159s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98178ab8-8267-4a33-bfa7-fd382bc4e504 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.662s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:27 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-98178ab8-8267-4a33-bfa7-fd382bc4e504 tempest-VolumesExtendTest-2060175697 None] Extend volume completed successfully.
Jul 19 19:58:27 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd" returned: 0 in 0.425s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:27 devstack sudo[101160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd
Jul 19 19:58:27 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:27 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9.2bb3a453-584d-46dd-be98-c8dc9571e3bd" returned: 0 in 0.280s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-2bb3a453-584d-46dd-be98-c8dc9571e3bd" released by "_delete_snapshot" :: held 1.695s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" released by "delete_snapshot" :: held 1.725s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Created reservations ['957d802a-1aa4-4158-b359-bc24e656bf4a', '7266d5dd-4891-449c-bc4a-4f72d2c03f42', 'd5799ca0-5c8e-474d-9ff0-590de650468c', 'a528a977-746f-4a26-bb50-f6fdf469725a'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:27 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Delete snapshot completed successfully.
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "cinder-659a5ebe-1011-4bd8-a575-d14d6019555d-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59eefc54-beb8-4475-93d2-7259acd5b06d tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-2bb3a453-584d-46dd-be98-c8dc9571e3bd-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-659a5ebe-1011-4bd8-a575-d14d6019555d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "cinder-quobyte-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-quobyte-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "cinder-quobyte-659a5ebe-1011-4bd8-a575-d14d6019555d" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-quobyte-659a5ebe-1011-4bd8-a575-d14d6019555d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Deleting offline snapshot 659a5ebe-1011-4bd8-a575-d14d6019555d of volume 6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] snapshot_file for this snap is: volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c1e917-0e18-4e1d-af21-dbc626965df7]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:28 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d
Jul 19 19:58:28 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-db79a285-c89f-4a44-a55e-aca6476752e9-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-db79a285-c89f-4a44-a55e-aca6476752e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a520aa58-32d2-400d-a39e-671d2cc2e678]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:28 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d" returned: 0 in 0.494s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b9648-ed31-475f-8aba-08dca26ac578]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:28 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9
Jul 19 19:58:28 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:28 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73
Jul 19 19:58:28 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:28 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9" returned: 0 in 0.436s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:29 devstack sudo[101175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9
Jul 19 19:58:29 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:29 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" returned: 0 in 0.451s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:29 devstack sudo[101182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d
Jul 19 19:58:29 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:29 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db79a285-c89f-4a44-a55e-aca6476752e9" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-quobyte-db79a285-c89f-4a44-a55e-aca6476752e9" released by "delete_volume" :: held 0.803s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Created reservations ['0ec335dc-afd8-4d64-9e96-1fc2693c20df', 'b5803f3b-fef2-4faf-88c5-f4824721eafa', '5a18be96-c418-413b-8605-120d60df4c1e', '3b9f92d3-c83a-43fd-b001-a8544821c806'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:29 devstack sudo[101188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:58:29 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:29 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d" returned: 0 in 0.471s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:29 devstack sudo[101191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d
Jul 19 19:58:29 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:29 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.319s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:58:29 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Deleted volume successfully.
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1898809-ac5f-42f8-8884-7373f7ec41a8 tempest-VolumesSnapshotListTestJSON-1125965625 None] Lock "cinder-db79a285-c89f-4a44-a55e-aca6476752e9-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:29 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73.659a5ebe-1011-4bd8-a575-d14d6019555d" returned: 0 in 0.297s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-quobyte-659a5ebe-1011-4bd8-a575-d14d6019555d" released by "_delete_snapshot" :: held 1.854s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-quobyte-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" released by "delete_snapshot" :: held 1.894s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:29 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Created reservations ['e03d5b35-bb2f-4955-899e-4c4fd90e1d48', 'e84d2650-37db-4357-9a6d-acad845c8aed', '705ebaae-0b70-41a8-bc38-0b0b0e62e0f4', '28f9d774-b3db-4a0c-94fa-29b673661a14'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Delete snapshot completed successfully.
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c9a15f76-c127-4b79-81cd-7f901c3abb08 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-659a5ebe-1011-4bd8-a575-d14d6019555d-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "cinder-6b094774-76a1-4ef9-8c0a-3655ee7c8d73-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-6b094774-76a1-4ef9-8c0a-3655ee7c8d73-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "cinder-quobyte-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-quobyte-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2511d863-2591-4e16-974e-63116c28b930]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:30 devstack sudo[101195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73
Jul 19 19:58:30 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:30 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" returned: 0 in 0.447s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:30 devstack sudo[101200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73
Jul 19 19:58:30 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:31 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-quobyte-6b094774-76a1-4ef9-8c0a-3655ee7c8d73" released by "delete_volume" :: held 0.832s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Created reservations ['612e52c6-bf60-4cf2-b93d-55bcf63b239f', 'dc283e4e-6c96-43ec-90cf-9021ef90f34a', 'fe4e1d34-211c-455c-a68c-25d93ebdb18c', 'ebf1c7f0-8f01-46f9-bb12-6d901eae7f0f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:31 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:58:31 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:31 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:58:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Deleted volume successfully.
Jul 19 19:58:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1719da89-2e84-4b9b-9279-b0d0f4765017 tempest-VolumesExtendTest-2060175697 None] Lock "cinder-6b094774-76a1-4ef9-8c0a-3655ee7c8d73-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Flow 'volume_create_manager' (dcdb7e76-f92f-4c09-836d-7eb3d00af217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34093830-2b30-4718-83cf-cc3b0324ebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34093830-2b30-4718-83cf-cc3b0324ebee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-804419448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92134247-c536-48bd-99d3-bdf98719f743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3329cf18ae44c7db4a0358d8f96ee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:32Z,use_quota=True,user_id='83e3289335f44f8d89404cff88436a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4113a7-5f9f-4aca-9c0e-020a97ee5ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4113a7-5f9f-4aca-9c0e-020a97ee5ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b227771-bd00-46b8-ad2a-aad80ec46f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b227771-bd00-46b8-ad2a-aad80ec46f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92134247-c536-48bd-99d3-bdf98719f743', 'volume_name': 'volume-92134247-c536-48bd-99d3-bdf98719f743', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856e33a3-f3e7-48ac-a6b9-5dd1cefe701b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856e33a3-f3e7-48ac-a6b9-5dd1cefe701b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1933eb4-0b7e-4edf-abab-5dd1e6fea4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Volume 92134247-c536-48bd-99d3-bdf98719f743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92134247-c536-48bd-99d3-bdf98719f743', 'volume_size': 1}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-804419448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92134247-c536-48bd-99d3-bdf98719f743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3329cf18ae44c7db4a0358d8f96ee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:32Z,use_quota=True,user_id='83e3289335f44f8d89404cff88436a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Creating volume 92134247-c536-48bd-99d3-bdf98719f743 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:58:32 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:32 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743 1073741824
Jul 19 19:58:32 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:32 devstack sudo[101214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:58:32 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Flow 'volume_create_manager' (85c9e126-5e27-459a-a2c4-3f1ffe7d43cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1634db5d-a5fc-4ce9-9694-dbb637cf8a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1634db5d-a5fc-4ce9-9694-dbb637cf8a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-502302292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b71b933-a3b1-493f-bd7a-cd407556f83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3329cf18ae44c7db4a0358d8f96ee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:33Z,use_quota=True,user_id='83e3289335f44f8d89404cff88436a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb731ee-ddf9-40a9-834b-577ff0874319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb731ee-ddf9-40a9-834b-577ff0874319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f8bd50-bcef-4d3c-ac31-a32a5beb42a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f8bd50-bcef-4d3c-ac31-a32a5beb42a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b71b933-a3b1-493f-bd7a-cd407556f83f', 'volume_name': 'volume-1b71b933-a3b1-493f-bd7a-cd407556f83f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024b6b72-c4e8-4bb0-b74c-3426d103637f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024b6b72-c4e8-4bb0-b74c-3426d103637f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062a8ede-7d99-4f30-86e2-9c6a2daa3d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Volume 1b71b933-a3b1-493f-bd7a-cd407556f83f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b71b933-a3b1-493f-bd7a-cd407556f83f', 'volume_size': 1}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:33 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.472s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:58:33 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743 1073741824" returned: 0 in 0.753s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:33 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743
Jul 19 19:58:33 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:33 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743" returned: 0 in 0.341s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-502302292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b71b933-a3b1-493f-bd7a-cd407556f83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3329cf18ae44c7db4a0358d8f96ee58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:33Z,use_quota=True,user_id='83e3289335f44f8d89404cff88436a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Creating volume 1b71b933-a3b1-493f-bd7a-cd407556f83f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:58:33 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1933eb4-0b7e-4edf-abab-5dd1e6fea4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92134247-c536-48bd-99d3-bdf98719f743', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f475d3e3-b974-4ea7-9a60-1b4692ce0434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:33 devstack sudo[101225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f 1073741824
Jul 19 19:58:33 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Volume volume-92134247-c536-48bd-99d3-bdf98719f743 (92134247-c536-48bd-99d3-bdf98719f743): created successfully
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f475d3e3-b974-4ea7-9a60-1b4692ce0434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Flow 'volume_create_manager' (dcdb7e76-f92f-4c09-836d-7eb3d00af217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d036d42a-f305-48a9-923e-e48949619dee tempest-TestServerVolumeAttachmentScenario-721180198 None] Created volume successfully.
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Flow 'volume_create_manager' (a4f95eae-5ff5-48c6-a6ba-36d9c02fa00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8ee451-ca73-463b-a1e8-9b12f38eb562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8ee451-ca73-463b-a1e8-9b12f38eb562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-773488397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbe062c-31a1-41c2-9c3e-fe7651bb78c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90c03b6c3794944aecbf53ae8dce96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:34Z,use_quota=True,user_id='c801723517cd4e9082192a4b9878f9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef965997-15f8-45ce-922a-1aaacbaec40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef965997-15f8-45ce-922a-1aaacbaec40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207a7876-3865-4a2f-bd96-89330338cd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207a7876-3865-4a2f-bd96-89330338cd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cbe062c-31a1-41c2-9c3e-fe7651bb78c3', 'volume_name': 'volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3', 'volume_size': 2}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c7556b-4906-49b9-9092-2b65ae9d83e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c7556b-4906-49b9-9092-2b65ae9d83e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202060f2-762c-42e8-b263-29423b1dc397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Volume 0cbe062c-31a1-41c2-9c3e-fe7651bb78c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3', 'volume_size': 2}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:34 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f 1073741824" returned: 0 in 0.644s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:34 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f
Jul 19 19:58:34 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:34 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f" returned: 0 in 0.275s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-773488397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbe062c-31a1-41c2-9c3e-fe7651bb78c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90c03b6c3794944aecbf53ae8dce96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:58:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:58:34Z,use_quota=True,user_id='c801723517cd4e9082192a4b9878f9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Creating volume 0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:58:34 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 2147483648 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:34 devstack sudo[101234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 2147483648
Jul 19 19:58:34 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062a8ede-7d99-4f30-86e2-9c6a2daa3d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b71b933-a3b1-493f-bd7a-cd407556f83f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf0e109-ce88-4a67-a9c9-0dec6a347197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Volume volume-1b71b933-a3b1-493f-bd7a-cd407556f83f (1b71b933-a3b1-493f-bd7a-cd407556f83f): created successfully
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf0e109-ce88-4a67-a9c9-0dec6a347197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Flow 'volume_create_manager' (85c9e126-5e27-459a-a2c4-3f1ffe7d43cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9d5e85bb-1691-4e48-ac5e-e7deff9eca8c tempest-TestServerVolumeAttachmentScenario-721180198 None] Created volume successfully.
Jul 19 19:58:35 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 2147483648" returned: 0 in 0.593s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:35 devstack sudo[101240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3
Jul 19 19:58:35 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:35 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202060f2-762c-42e8-b263-29423b1dc397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3', 'volume_size': 2}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ea1360-16c4-4088-b848-26d5971a2101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:58:35 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Volume volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 (0cbe062c-31a1-41c2-9c3e-fe7651bb78c3): created successfully
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ea1360-16c4-4088-b848-26d5971a2101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:58:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Flow 'volume_create_manager' (a4f95eae-5ff5-48c6-a6ba-36d9c02fa00c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:58:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-cca770d0-e3f9-4404-b24b-b4424d6994ca tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Created volume successfully.
Jul 19 19:58:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Creating offline snapshot a386226f-d6a7-46f2-8324-ee2fc0ec3b52 of volume 0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:58:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6fdeb9-0a0b-4c30-b545-4dec9c6804a6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:36 devstack sudo[101246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3
Jul 19 19:58:36 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:36 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" returned: 0 in 0.445s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 2G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:36 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 2G
Jul 19 19:58:36 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:37 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 2G" returned: 0 in 0.526s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:37 devstack sudo[101257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52
Jul 19 19:58:37 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:37 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52" returned: 0 in 0.408s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:37 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 is being set with open permissions: ugo+rw
Jul 19 19:58:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:37 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52
Jul 19 19:58:37 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:38 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52" returned: 0 in 0.321s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:38 devstack sudo[101269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.info
Jul 19 19:58:38 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:38 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.info" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:38 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.info is being set with open permissions: ugo+rw
Jul 19 19:58:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:38 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.info
Jul 19 19:58:38 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:38 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.info" returned: 0 in 0.381s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-86f9ea55-5989-4e76-81eb-7369a11057f2 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Create snapshot completed successfully
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "cinder-a386226f-d6a7-46f2-8324-ee2fc0ec3b52-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-a386226f-d6a7-46f2-8324-ee2fc0ec3b52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "cinder-quobyte-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-quobyte-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "cinder-quobyte-a386226f-d6a7-46f2-8324-ee2fc0ec3b52" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-quobyte-a386226f-d6a7-46f2-8324-ee2fc0ec3b52" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Deleting offline snapshot a386226f-d6a7-46f2-8324-ee2fc0ec3b52 of volume 0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] snapshot_file for this snap is: volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a53d2-f7cb-4da2-9765-2070b964002f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:39 devstack sudo[101287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52
Jul 19 19:58:39 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:40 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52" returned: 0 in 0.434s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 19:58:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a6b6a-7cce-450d-922c-a8d5ad4985ef]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:40 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3
Jul 19 19:58:40 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:40 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" returned: 0 in 0.643s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:41 devstack sudo[101319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52
Jul 19 19:58:41 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:41 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52" returned: 0 in 0.607s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:41 devstack sudo[101364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52
Jul 19 19:58:41 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:41 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3.a386226f-d6a7-46f2-8324-ee2fc0ec3b52" returned: 0 in 0.402s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-quobyte-a386226f-d6a7-46f2-8324-ee2fc0ec3b52" released by "_delete_snapshot" :: held 2.276s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-quobyte-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" released by "delete_snapshot" :: held 2.316s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:42 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Created reservations ['64278777-0e36-4ba4-9e20-3de1d3422873', 'af8a104c-1987-46e6-9142-4034543f93ea', '1956eaa7-31f2-49a6-bff6-b3f1d058daec', 'b10a26f7-40fc-40a9-9667-d315a4dfb34d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Delete snapshot completed successfully.
Jul 19 19:58:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c7682da7-6c63-4b5f-8ce7-71a7d06c7a5f tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-a386226f-d6a7-46f2-8324-ee2fc0ec3b52-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "cinder-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "cinder-quobyte-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-quobyte-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9366ff86-e4e1-4591-99a2-57b5d506a518]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:43 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3
Jul 19 19:58:43 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:43 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" returned: 0 in 0.431s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:43 devstack sudo[101377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3
Jul 19 19:58:43 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:43 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" returned: 0 in 0.272s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-quobyte-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3" released by "delete_volume" :: held 0.794s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Created reservations ['24f5aa6f-964f-45d6-92ec-3aeddbb99094', 'aab2e748-1e50-4b1c-9699-7bc805a215ba', 'c7582a03-2e6c-490e-b7d6-2eab1b2656ff', '081ec087-312c-4d80-8a56-609199e1d77b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:58:44 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:58:44 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:58:44 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.470s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:58:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Deleted volume successfully.
Jul 19 19:58:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0763822f-097e-456a-b4bb-4bd15ab81da8 tempest-VolumesSnapshotNegativeTestJSON-1996579472 None] Lock "cinder-0cbe062c-31a1-41c2-9c3e-fe7651bb78c3-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:58:54 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=169,cinder:DELETE=10,cinder:SELECT=115,cinder:INSERT=41 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:58:54 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=129,cinder:UPDATE=132,cinder:INSERT=47,cinder:DELETE=14 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:59:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-1241694e-9aa4-40d6-8efd-f289a3ffe230 req-6d6a6afd-9907-43c2-ae49-3ae250d74e5a tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-1241694e-9aa4-40d6-8efd-f289a3ffe230 req-6d6a6afd-9907-43c2-ae49-3ae250d74e5a tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-1241694e-9aa4-40d6-8efd-f289a3ffe230 req-6d6a6afd-9907-43c2-ae49-3ae250d74e5a tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-1241694e-9aa4-40d6-8efd-f289a3ffe230 req-6d6a6afd-9907-43c2-ae49-3ae250d74e5a tempest-TestServerVolumeAttachmentScenario-721180198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-92134247-c536-48bd-99d3-bdf98719f743', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd42259aa-bf5b-4bc7-8ed1-7873c832cd15', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:59:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-1241694e-9aa4-40d6-8efd-f289a3ffe230 req-6d6a6afd-9907-43c2-ae49-3ae250d74e5a tempest-TestServerVolumeAttachmentScenario-721180198 None] attachment_update completed successfully.
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Flow 'volume_create_manager' (4a78d010-8b65-4f0f-938c-134440cb0a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949fb3d1-2b54-4a47-94f8-d21e69ffac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949fb3d1-2b54-4a47-94f8-d21e69ffac64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-828451342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a6f204-6bc1-4b96-84ff-36cfcb583a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63716c6aaa04c0cab2948e165441409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:59:16Z,use_quota=True,user_id='112e5f00effc44d0b69d01b9d7123c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57a4a64-8288-43a3-b51f-1156ee32cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57a4a64-8288-43a3-b51f-1156ee32cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc933f-646c-4fc7-951d-d63a83a88795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc933f-646c-4fc7-951d-d63a83a88795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a6f204-6bc1-4b96-84ff-36cfcb583a5c', 'volume_name': 'volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d383ea-1534-4f85-adbe-37de4deb961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d383ea-1534-4f85-adbe-37de4deb961d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97167b6-fccc-4f97-a2a5-07aa72b48e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:16 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Volume 10a6f204-6bc1-4b96-84ff-36cfcb583a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c', 'volume_size': 1}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-828451342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a6f204-6bc1-4b96-84ff-36cfcb583a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63716c6aaa04c0cab2948e165441409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:59:16Z,use_quota=True,user_id='112e5f00effc44d0b69d01b9d7123c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Creating volume 10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:59:16 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:59:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:16 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c 1073741824
Jul 19 19:59:16 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:17 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c 1073741824" returned: 0 in 0.765s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:17 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c
Jul 19 19:59:17 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:17 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" returned: 0 in 0.370s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97167b6-fccc-4f97-a2a5-07aa72b48e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c53fece-7182-4cfd-bba9-a909e6bd03b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:17 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Volume volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c (10a6f204-6bc1-4b96-84ff-36cfcb583a5c): created successfully
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c53fece-7182-4cfd-bba9-a909e6bd03b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:17 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Flow 'volume_create_manager' (4a78d010-8b65-4f0f-938c-134440cb0a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:59:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2c0265bb-dec6-42e1-8f6a-e878eb4e1ec6 tempest-TestStampPattern-1113286556 None] Created volume successfully.
Jul 19 19:59:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3f8105f2-62f3-4cbe-ad44-d058bb206996 req-c56a5aa1-e148-41ca-a5ea-65c9f47e62ae tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3f8105f2-62f3-4cbe-ad44-d058bb206996 req-c56a5aa1-e148-41ca-a5ea-65c9f47e62ae tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-3f8105f2-62f3-4cbe-ad44-d058bb206996 req-c56a5aa1-e148-41ca-a5ea-65c9f47e62ae tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-3f8105f2-62f3-4cbe-ad44-d058bb206996 req-c56a5aa1-e148-41ca-a5ea-65c9f47e62ae tempest-TestServerVolumeAttachmentScenario-721180198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-1b71b933-a3b1-493f-bd7a-cd407556f83f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3477d657-f233-4f51-9b28-9a437446619b', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:59:18 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-3f8105f2-62f3-4cbe-ad44-d058bb206996 req-c56a5aa1-e148-41ca-a5ea-65c9f47e62ae tempest-TestServerVolumeAttachmentScenario-721180198 None] attachment_update completed successfully.
Jul 19 19:59:21 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-8fca47ad-d160-4ed9-b670-4aa94da4c192 req-168b9e49-ba3d-4cd9-a41a-33db2da6037f tempest-TestServerVolumeAttachmentScenario-721180198 None] Terminate volume connection completed successfully.
Jul 19 19:59:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-8fca47ad-d160-4ed9-b670-4aa94da4c192 req-168b9e49-ba3d-4cd9-a41a-33db2da6037f tempest-TestServerVolumeAttachmentScenario-721180198 None] Deleting attachment 3477d657-f233-4f51-9b28-9a437446619b. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:59:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-b997bd53-7e6e-4234-8b24-96b9139fe7ae req-dd5ee97c-1f64-4ebd-886f-d151ef1dce2b tempest-TestServerVolumeAttachmentScenario-721180198 None] Terminate volume connection completed successfully.
Jul 19 19:59:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-b997bd53-7e6e-4234-8b24-96b9139fe7ae req-dd5ee97c-1f64-4ebd-886f-d151ef1dce2b tempest-TestServerVolumeAttachmentScenario-721180198 None] Deleting attachment d42259aa-bf5b-4bc7-8ed1-7873c832cd15. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "cinder-1b71b933-a3b1-493f-bd7a-cd407556f83f-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "cinder-1b71b933-a3b1-493f-bd7a-cd407556f83f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "cinder-quobyte-1b71b933-a3b1-493f-bd7a-cd407556f83f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "cinder-quobyte-1b71b933-a3b1-493f-bd7a-cd407556f83f" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf128e-7fda-42c0-94ba-50e554e3cfeb]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:29 devstack sudo[102152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f
Jul 19 19:59:29 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:29 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f" returned: 0 in 0.385s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:29 devstack sudo[102158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f
Jul 19 19:59:29 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:29 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1b71b933-a3b1-493f-bd7a-cd407556f83f" returned: 0 in 0.276s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "cinder-quobyte-1b71b933-a3b1-493f-bd7a-cd407556f83f" released by "delete_volume" :: held 0.721s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Created reservations ['adb2acbd-c233-4d24-aaef-dea48b7d1fd8', '7aa9c357-96e0-4f72-8463-d7238395796d', 'f9a75af7-2573-483b-bf6c-dae6dd82fc35', '0cb611f3-6cb1-4117-861d-c2ac62ee2c72'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:29 devstack sudo[102161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:59:29 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:30 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.262s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:59:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Deleted volume successfully.
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "cinder-92134247-c536-48bd-99d3-bdf98719f743-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-242ffe1e-c84a-4cf8-9df9-82470634fb7d tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "cinder-1b71b933-a3b1-493f-bd7a-cd407556f83f-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "cinder-92134247-c536-48bd-99d3-bdf98719f743-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "cinder-quobyte-92134247-c536-48bd-99d3-bdf98719f743" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "cinder-quobyte-92134247-c536-48bd-99d3-bdf98719f743" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb40b40-bd8a-47b3-bbf3-1a795654e597]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:30 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743
Jul 19 19:59:30 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:30 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743" returned: 0 in 0.386s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:30 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743
Jul 19 19:59:30 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:31 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-92134247-c536-48bd-99d3-bdf98719f743" returned: 0 in 0.258s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "cinder-quobyte-92134247-c536-48bd-99d3-bdf98719f743" released by "delete_volume" :: held 0.679s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Created reservations ['321e01fe-a51e-4012-9f0d-05efbca72e31', 'e53f267a-dd37-422f-9a6b-e82a4965a684', 'ba178885-3464-4295-8204-e967ef15026c', '633783de-ce83-4fe3-a07f-ac7fecaa6022'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:31 devstack sudo[102172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:59:31 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:31 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.258s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:59:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Deleted volume successfully.
Jul 19 19:59:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c89dc08-c5c2-41b5-b7ab-6a6855349cc5 tempest-TestServerVolumeAttachmentScenario-721180198 None] Lock "cinder-92134247-c536-48bd-99d3-bdf98719f743-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:59:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:59:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:59:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:59:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:32 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:59:32 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:33 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.382s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:59:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 19:59:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 19:59:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Flow 'volume_create_manager' (2076738a-de5d-47d9-899b-4746075e3725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbfb5db-7d3c-4ba0-9c92-2f60bc368828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbfb5db-7d3c-4ba0-9c92-2f60bc368828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1374126509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9854b2b5-b38d-4867-84d1-2a9775bf08af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f3be7e54234c9694d8a875beebc704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:59:38Z,use_quota=True,user_id='0684595530ae4e8bae0e6309476fd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b441ddb3-bd32-442a-9eb8-ffecd1eb51c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b441ddb3-bd32-442a-9eb8-ffecd1eb51c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1332dfc5-3a5d-4f5c-8dec-2afbf9ca61cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1332dfc5-3a5d-4f5c-8dec-2afbf9ca61cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9854b2b5-b38d-4867-84d1-2a9775bf08af', 'volume_name': 'volume-9854b2b5-b38d-4867-84d1-2a9775bf08af', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76422b8a-7bc6-4c4f-96a1-61435d136cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76422b8a-7bc6-4c4f-96a1-61435d136cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9af2c1-ad50-4fc1-91c0-a937748ea7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Volume 9854b2b5-b38d-4867-84d1-2a9775bf08af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9854b2b5-b38d-4867-84d1-2a9775bf08af', 'volume_size': 1}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1374126509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9854b2b5-b38d-4867-84d1-2a9775bf08af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f3be7e54234c9694d8a875beebc704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:59:38Z,use_quota=True,user_id='0684595530ae4e8bae0e6309476fd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Creating volume 9854b2b5-b38d-4867-84d1-2a9775bf08af {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:59:37 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:59:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:37 devstack sudo[102217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af 1073741824
Jul 19 19:59:37 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:38 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af 1073741824" returned: 0 in 0.524s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:38 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af
Jul 19 19:59:38 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:38 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af" returned: 0 in 0.281s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9af2c1-ad50-4fc1-91c0-a937748ea7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9854b2b5-b38d-4867-84d1-2a9775bf08af', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b558376-53c9-4e93-a025-32d9b6035822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:38 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Volume volume-9854b2b5-b38d-4867-84d1-2a9775bf08af (9854b2b5-b38d-4867-84d1-2a9775bf08af): created successfully
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b558376-53c9-4e93-a025-32d9b6035822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Flow 'volume_create_manager' (2076738a-de5d-47d9-899b-4746075e3725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:59:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-98370e4d-8742-40e8-9631-b514046ba52d tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Created volume successfully.
Jul 19 19:59:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e74c90dc-a78a-4382-907e-c68e722b8d02 req-74dee626-7824-43a7-a9cc-bb74fc8f02cb tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e74c90dc-a78a-4382-907e-c68e722b8d02 req-74dee626-7824-43a7-a9cc-bb74fc8f02cb tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e74c90dc-a78a-4382-907e-c68e722b8d02 req-74dee626-7824-43a7-a9cc-bb74fc8f02cb tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-e74c90dc-a78a-4382-907e-c68e722b8d02 req-74dee626-7824-43a7-a9cc-bb74fc8f02cb tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-9854b2b5-b38d-4867-84d1-2a9775bf08af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e8558e8-bfb0-4366-be81-4fcf3a07b3a7', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:59:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-e74c90dc-a78a-4382-907e-c68e722b8d02 req-74dee626-7824-43a7-a9cc-bb74fc8f02cb tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] attachment_update completed successfully.
Jul 19 19:59:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-0866d209-16a4-4f96-8777-cee0821c84ac req-49a10dfe-6930-4b7a-ae22-9ddcfcd28a99 tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Terminate volume connection completed successfully.
Jul 19 19:59:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-0866d209-16a4-4f96-8777-cee0821c84ac req-49a10dfe-6930-4b7a-ae22-9ddcfcd28a99 tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Deleting attachment 6e8558e8-bfb0-4366-be81-4fcf3a07b3a7. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Flow 'volume_create_manager' (7c57a577-1347-44db-83ad-e94a61cc8f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4fa0e8-4b89-450d-a03b-ca873d89379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Acquiring lock "cinder-9854b2b5-b38d-4867-84d1-2a9775bf08af-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4fa0e8-4b89-450d-a03b-ca873d89379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5aeb10-c6f5-4f67-a63a-93170146fe2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05935608ee4b2a87d79fc8ecb26819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:59:45Z,use_quota=True,user_id='982b29511504418ebcb1fb90101b02ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb4eb24-b284-43c4-aabc-f221cc751b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb4eb24-b284-43c4-aabc-f221cc751b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf81c46-18e2-4ba8-ac0e-d17485ffc1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "cinder-9854b2b5-b38d-4867-84d1-2a9775bf08af-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Acquiring lock "cinder-quobyte-9854b2b5-b38d-4867-84d1-2a9775bf08af" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "cinder-quobyte-9854b2b5-b38d-4867-84d1-2a9775bf08af" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2220c96f-9387-453b-97e9-e8642e3674d8]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:45 devstack sudo[102651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af
Jul 19 19:59:45 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf81c46-18e2-4ba8-ac0e-d17485ffc1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e5aeb10-c6f5-4f67-a63a-93170146fe2b', 'volume_name': 'volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b', 'volume_size': 1, 'image_id': 'f1545dc5-9576-41f1-854a-d44c7f845f92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1545dc5-9576-41f1-854a-d44c7f845f92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ed98ef52592ab20c99fe6427d955995', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e05935608ee4b2a87d79fc8ecb26819', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b49e4ca9f6532cfc790d1fa75e3946b3218c49a490b3bc76ff41affe03acfbd49f0a9cfbb2ba46a3c31067239da56daf61fec866f4f177d52f01e53ee6128799', 'id': 'f1545dc5-9576-41f1-854a-d44c7f845f92', 'created_at': datetime.datetime(2026, 7, 19, 17, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 59, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1545dc5-9576-41f1-854a-d44c7f845f92/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442d6dda90>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b916fb-4aaa-48ab-afd0-83fcb17b4bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b916fb-4aaa-48ab-afd0-83fcb17b4bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66c8be2-f822-496f-839f-7f1470f470a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:45 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Volume 4e5aeb10-c6f5-4f67-a63a-93170146fe2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b', 'volume_size': 1, 'image_id': 'f1545dc5-9576-41f1-854a-d44c7f845f92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1545dc5-9576-41f1-854a-d44c7f845f92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ed98ef52592ab20c99fe6427d955995', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e05935608ee4b2a87d79fc8ecb26819', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b49e4ca9f6532cfc790d1fa75e3946b3218c49a490b3bc76ff41affe03acfbd49f0a9cfbb2ba46a3c31067239da56daf61fec866f4f177d52f01e53ee6128799', 'id': 'f1545dc5-9576-41f1-854a-d44c7f845f92', 'created_at': datetime.datetime(2026, 7, 19, 17, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 59, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1545dc5-9576-41f1-854a-d44c7f845f92/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442d6dda90>}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Trying to clone 4e5aeb10-c6f5-4f67-a63a-93170146fe2b from image f1545dc5-9576-41f1-854a-d44c7f845f92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f1545dc5-9576-41f1-854a-d44c7f845f92', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 19:59:45 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Image download 0.00 MB at 0.00 MB/s
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f71b835-2f89-402e-8a34-45ed48a00c11]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:45 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af" returned: 0 in 0.394s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:45 devstack sudo[102657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af
Jul 19 19:59:45 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:45 devstack sudo[102656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD
Jul 19 19:59:45 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:45 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9854b2b5-b38d-4867-84d1-2a9775bf08af" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "cinder-quobyte-9854b2b5-b38d-4867-84d1-2a9775bf08af" released by "delete_volume" :: held 0.693s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:59:45 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Created reservations ['9bb4b17a-c005-44fb-8328-f8c43bcc96f4', 'd98b504a-1e32-4358-90e1-cd8cad948823', '57a01764-5e5b-4612-9cd3-cfcf2aeefa2b', '3b304716-dade-4968-b194-75860ad22d49'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:46 devstack sudo[102664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:59:46 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:46 devstack sudo[102663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD
Jul 19 19:59:46 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:46 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:46 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.263s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Temporary image f1545dc5-9576-41f1-854a-d44c7f845f92 is fetched for user 982b29511504418ebcb1fb90101b02ce. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 19:59:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Deleted volume successfully.
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4cda0fda-ca71-4da0-a22a-3b319f4428ae tempest-TestServerVolumeAttachScenarioOldVersion-609989618 None] Lock "cinder-9854b2b5-b38d-4867-84d1-2a9775bf08af-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e84e1-d28c-4000-ad4b-2e62aff63c6b]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:46 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD
Jul 19 19:59:46 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:46 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:46 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD
Jul 19 19:59:46 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:47 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T17:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5aeb10-c6f5-4f67-a63a-93170146fe2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e05935608ee4b2a87d79fc8ecb26819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T17:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T17:59:45Z,use_quota=True,user_id='982b29511504418ebcb1fb90101b02ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Creating volume 4e5aeb10-c6f5-4f67-a63a-93170146fe2b {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 19:59:47 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:47 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b 1073741824
Jul 19 19:59:47 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:47 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b 1073741824" returned: 0 in 0.525s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:47 devstack sudo[102709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b
Jul 19 19:59:47 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:48 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b" returned: 0 in 0.319s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Attempting download of f1545dc5-9576-41f1-854a-d44c7f845f92 ((None, [{'url': 'file:///opt/stack/data/glance/images/f1545dc5-9576-41f1-854a-d44c7f845f92', 'metadata': {}}])) to volume 4e5aeb10-c6f5-4f67-a63a-93170146fe2b. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d424c14d-1d4d-4730-9dec-ea420d704a6a]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1545dc5-9576-41f1-854a-d44c7f845f92_pcsrzzc5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:48 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1545dc5-9576-41f1-854a-d44c7f845f92_pcsrzzc5
Jul 19 19:59:48 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:48 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1545dc5-9576-41f1-854a-d44c7f845f92_pcsrzzc5" returned: 0 in 0.354s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1545dc5-9576-41f1-854a-d44c7f845f92_pcsrzzc5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:48 devstack sudo[102717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1545dc5-9576-41f1-854a-d44c7f845f92_pcsrzzc5
Jul 19 19:59:48 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:48 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1545dc5-9576-41f1-854a-d44c7f845f92_pcsrzzc5" returned: 1 in 0.333s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1545dc5-9576-41f1-854a-d44c7f845f92_pcsrzzc5' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d785cb-7805-4444-b125-13cf84b45765]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:48 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD
Jul 19 19:59:48 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:49 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:49 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD
Jul 19 19:59:49 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:49 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 19:59:49 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] f1545dc5-9576-41f1-854a-d44c7f845f92 was raw, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 19:59:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:49 devstack sudo[102737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b
Jul 19 19:59:49 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-bed14d0f-9217-41dc-93fd-1d5695db92df req-65666093-38e7-4eae-a280-f012a411c300 tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-bed14d0f-9217-41dc-93fd-1d5695db92df req-65666093-38e7-4eae-a280-f012a411c300 tempest-TestStampPattern-1113286556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-bed14d0f-9217-41dc-93fd-1d5695db92df req-65666093-38e7-4eae-a280-f012a411c300 tempest-TestStampPattern-1113286556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-bed14d0f-9217-41dc-93fd-1d5695db92df req-65666093-38e7-4eae-a280-f012a411c300 tempest-TestStampPattern-1113286556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '967a2f24-620d-4e39-b92a-cbb333924eed', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 19:59:50 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-bed14d0f-9217-41dc-93fd-1d5695db92df req-65666093-38e7-4eae-a280-f012a411c300 tempest-TestStampPattern-1113286556 None] attachment_update completed successfully.
Jul 19 19:59:50 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b" returned: 0 in 0.640s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f1545dc5-9576-41f1-854a-d44c7f845f92_lcvpcnindevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 19:59:50 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Converted 0.00 MB image at 0.00 MB/s
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:50 devstack sudo[102753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b 1G
Jul 19 19:59:50 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:50 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b 1G" returned: 0 in 0.381s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Downloaded image f1545dc5-9576-41f1-854a-d44c7f845f92 ((None, [{'url': 'file:///opt/stack/data/glance/images/f1545dc5-9576-41f1-854a-d44c7f845f92', 'metadata': {}}])) to volume 4e5aeb10-c6f5-4f67-a63a-93170146fe2b successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Temporary image f1545dc5-9576-41f1-854a-d44c7f845f92 for user 982b29511504418ebcb1fb90101b02ce is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Marking volume 4e5aeb10-c6f5-4f67-a63a-93170146fe2b as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Copying metadata from image f1545dc5-9576-41f1-854a-d44c7f845f92 to 4e5aeb10-c6f5-4f67-a63a-93170146fe2b. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Creating volume glance metadata for volume 4e5aeb10-c6f5-4f67-a63a-93170146fe2b backed by image f1545dc5-9576-41f1-854a-d44c7f845f92 with: {'image_id': 'f1545dc5-9576-41f1-854a-d44c7f845f92', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2ed98ef52592ab20c99fe6427d955995', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66c8be2-f822-496f-839f-7f1470f470a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b', 'volume_size': 1, 'image_id': 'f1545dc5-9576-41f1-854a-d44c7f845f92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1545dc5-9576-41f1-854a-d44c7f845f92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ed98ef52592ab20c99fe6427d955995', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7e05935608ee4b2a87d79fc8ecb26819', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b49e4ca9f6532cfc790d1fa75e3946b3218c49a490b3bc76ff41affe03acfbd49f0a9cfbb2ba46a3c31067239da56daf61fec866f4f177d52f01e53ee6128799', 'id': 'f1545dc5-9576-41f1-854a-d44c7f845f92', 'created_at': datetime.datetime(2026, 7, 19, 17, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 59, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1545dc5-9576-41f1-854a-d44c7f845f92/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442d6dda90>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad8a6fe-c2ea-4ab5-b562-9fcf18d13e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 19:59:50 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Volume volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b (4e5aeb10-c6f5-4f67-a63a-93170146fe2b): created successfully
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad8a6fe-c2ea-4ab5-b562-9fcf18d13e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 19:59:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Flow 'volume_create_manager' (7c57a577-1347-44db-83ad-e94a61cc8f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 19:59:50 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d3b8e9ec-9812-47bf-8b59-1cfab035aa0f tempest-VolumeImageDependencyTests-1630250542 None] Created volume successfully.
Jul 19 19:59:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Acquiring lock "cinder-4e5aeb10-c6f5-4f67-a63a-93170146fe2b-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:59:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Lock "cinder-4e5aeb10-c6f5-4f67-a63a-93170146fe2b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:59:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Acquiring lock "cinder-quobyte-4e5aeb10-c6f5-4f67-a63a-93170146fe2b" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 19:59:51 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Lock "cinder-quobyte-4e5aeb10-c6f5-4f67-a63a-93170146fe2b" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 19:59:51 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eda38cc-71a1-4858-af01-dfc609c36ad8]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:51 devstack sudo[103141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b
Jul 19 19:59:51 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:51 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b" returned: 0 in 0.352s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:51 devstack sudo[103146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b
Jul 19 19:59:51 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:52 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4e5aeb10-c6f5-4f67-a63a-93170146fe2b" returned: 0 in 0.258s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Lock "cinder-quobyte-4e5aeb10-c6f5-4f67-a63a-93170146fe2b" released by "delete_volume" :: held 0.661s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Created reservations ['ebdb2fcf-a303-41bb-b7a6-fdd3fcaccdd4', '6e069f02-dd68-4492-ab48-270b264bbaf6', '02f4d561-2007-473f-86c8-41021384708f', '5dc1e7ce-c831-4972-b252-dde732eee2e6'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:52 devstack sudo[103156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 19:59:52 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:52 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 19:59:52 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Deleted volume successfully.
Jul 19 19:59:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde2b70-db52-4a09-b3b7-c950b5345c41 tempest-VolumeImageDependencyTests-1630250542 None] Lock "cinder-4e5aeb10-c6f5-4f67-a63a-93170146fe2b-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 19:59:56 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=64,cinder:UPDATE=51,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 19:59:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-60f22163-6f73-4363-a8f1-706e1a012ca4 req-ca3642f8-470f-4a7c-a29f-ec455f48e526 tempest-TestStampPattern-1113286556 None] Terminate volume connection completed successfully.
Jul 19 19:59:56 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-60f22163-6f73-4363-a8f1-706e1a012ca4 req-ca3642f8-470f-4a7c-a29f-ec455f48e526 tempest-TestStampPattern-1113286556 None] Deleting attachment 967a2f24-620d-4e39-b92a-cbb333924eed. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 19:59:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 19:59:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 19:59:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Creating offline snapshot 9f5d9391-20ab-4e70-a731-9fca60063629 of volume 10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 19:59:57 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30b206-3389-43e8-b8f6-bb95285b3ef1]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 19:59:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:57 devstack sudo[103205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c
Jul 19 19:59:57 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:57 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" returned: 0 in 0.445s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:57 devstack sudo[103210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 1G
Jul 19 19:59:57 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:58 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 1G" returned: 0 in 0.589s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:58 devstack sudo[103216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629
Jul 19 19:59:58 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:58 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629" returned: 0 in 0.349s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:58 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 is being set with open permissions: ugo+rw
Jul 19 19:59:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:58 devstack sudo[103222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629
Jul 19 19:59:58 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:58 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629" returned: 0 in 0.294s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:58 devstack sudo[103226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.info
Jul 19 19:59:58 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:59 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.info" returned: 0 in 0.372s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:59 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.info is being set with open permissions: ugo+rw
Jul 19 19:59:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 19:59:59 devstack sudo[103229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.info
Jul 19 19:59:59 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 19:59:59 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root
Jul 19 19:59:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.info" returned: 0 in 0.263s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 19:59:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 19:59:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9fe4cd31-7b12-414a-958e-2da25486ca23 tempest-TestStampPattern-1113286556 None] Create snapshot completed successfully
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=66,cinder:UPDATE=48,cinder:DELETE=6,cinder:INSERT=11 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Flow 'volume_create_manager' (4292fa00-eba1-4efd-97e4-70fa436c6d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7d3ef8-6008-4d27-af2d-189bf19142dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7d3ef8-6008-4d27-af2d-189bf19142dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-552773038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8427ba-d550-424d-80f8-53ed88142e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63716c6aaa04c0cab2948e165441409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f5d9391-20ab-4e70-a731-9fca60063629,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:00:07Z,use_quota=True,user_id='112e5f00effc44d0b69d01b9d7123c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8cee88-5a6d-42be-b76e-a5b0d17cbcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8cee88-5a6d-42be-b76e-a5b0d17cbcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563a2211-55be-437b-a7c5-ceff2a413956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563a2211-55be-437b-a7c5-ceff2a413956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db8427ba-d550-424d-80f8-53ed88142e29', 'volume_name': 'volume-db8427ba-d550-424d-80f8-53ed88142e29', 'volume_size': 1, 'snapshot_id': '9f5d9391-20ab-4e70-a731-9fca60063629'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9720c93a-e74b-48cf-ae1a-dc0261025114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9720c93a-e74b-48cf-ae1a-dc0261025114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbf59e3-8b95-4ca5-8ca9-3f056c754af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:07 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Volume db8427ba-d550-424d-80f8-53ed88142e29: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db8427ba-d550-424d-80f8-53ed88142e29', 'volume_size': 1, 'snapshot_id': '9f5d9391-20ab-4e70-a731-9fca60063629'}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-quobyte-9f5d9391-20ab-4e70-a731-9fca60063629-db8427ba-d550-424d-80f8-53ed88142e29" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-9f5d9391-20ab-4e70-a731-9fca60063629-db8427ba-d550-424d-80f8-53ed88142e29" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Creating volume db8427ba-d550-424d-80f8-53ed88142e29 from snapshot 9f5d9391-20ab-4e70-a731-9fca60063629 {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-quobyte-db8427ba-d550-424d-80f8-53ed88142e29" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-db8427ba-d550-424d-80f8-53ed88142e29" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] snapshot: 9f5d9391-20ab-4e70-a731-9fca60063629, volume: db8427ba-d550-424d-80f8-53ed88142e29,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbdcc99-879e-4176-aaec-c3f911f0f109]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:07 devstack sudo[103261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629
Jul 19 20:00:07 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:07 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629" returned: 0 in 0.394s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf65f286-2179-4cf6-aae4-118b6e81bc64]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:00:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:07 devstack sudo[103266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c
Jul 19 20:00:07 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:08 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" returned: 0 in 0.419s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:08 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29 not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 20:00:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:08 devstack sudo[103274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29
Jul 19 20:00:08 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:15 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29" returned: 0 in 6.818s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:15 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e48a4b-8909-40dc-8cbc-943fc5e37988]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:00:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:15 devstack sudo[103296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c
Jul 19 20:00:15 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:15 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" returned: 0 in 0.762s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:15 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 20:00:15 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Converted 1024.00 MB image at 150.15 MB/s
Jul 19 20:00:15 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29 is being set with open permissions: ugo+rw
Jul 19 20:00:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:15 devstack sudo[103311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29
Jul 19 20:00:15 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:16 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-db8427ba-d550-424d-80f8-53ed88142e29" released by "_copy_volume_from_snapshot" :: held 8.816s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:00:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-9f5d9391-20ab-4e70-a731-9fca60063629-db8427ba-d550-424d-80f8-53ed88142e29" released by "_create_volume_from_snapshot" :: held 8.870s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:00:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.891s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:00:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbf59e3-8b95-4ca5-8ca9-3f056c754af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8427ba-d550-424d-80f8-53ed88142e29', 'volume_size': 1, 'snapshot_id': '9f5d9391-20ab-4e70-a731-9fca60063629'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cb9da2-91f7-407f-bcb2-88f8b3a5742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:16 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Volume volume-db8427ba-d550-424d-80f8-53ed88142e29 (db8427ba-d550-424d-80f8-53ed88142e29): created successfully
Jul 19 20:00:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cb9da2-91f7-407f-bcb2-88f8b3a5742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Flow 'volume_create_manager' (4292fa00-eba1-4efd-97e4-70fa436c6d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:00:16 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4301924d-d152-4a69-beab-eba0de696bdd tempest-TestStampPattern-1113286556 None] Created volume successfully.
Jul 19 20:00:26 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:00:26 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Flow 'volume_create_manager' (2c4c6347-6b91-4526-bc46-7eaead8e1211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6dcfb34-471f-4fd3-9f79-f345a7c13967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6dcfb34-471f-4fd3-9f79-f345a7c13967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2090734492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7ba9f0-b9bd-428a-901f-1de1e446cfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5927e80a5794e3981574169de8b73b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:00:32Z,use_quota=True,user_id='45ed1e8504464303b73ff12a6a51fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6536c735-82bf-4887-a4d8-c866e366486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6536c735-82bf-4887-a4d8-c866e366486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635893fb-5d98-4b7b-9370-aed577a931c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635893fb-5d98-4b7b-9370-aed577a931c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c7ba9f0-b9bd-428a-901f-1de1e446cfa6', 'volume_name': 'volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb6510>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e692ff1-2878-41c9-84a4-d6d75d2d1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e692ff1-2878-41c9-84a4-d6d75d2d1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c9a59b-330d-45c7-b803-522c34b88b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Volume 2c7ba9f0-b9bd-428a-901f-1de1e446cfa6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb6510>}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Trying to clone 2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 from image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab at location (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 20:00:32 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Image download 20.69 MB at 20.69 MB/s
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d51633b-3ad5-4420-bfd7-d812a6001c67]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:00:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:32 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:00:32 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:32 devstack sudo[103426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD
Jul 19 20:00:32 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:33 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.266s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 20:00:33 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Temporary image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab is fetched for user 45ed1e8504464303b73ff12a6a51fa74. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30267a4-379c-4c23-9d82-17953c5148d5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:33 devstack sudo[103434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD
Jul 19 20:00:33 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:33 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2090734492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7ba9f0-b9bd-428a-901f-1de1e446cfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5927e80a5794e3981574169de8b73b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:00:32Z,use_quota=True,user_id='45ed1e8504464303b73ff12a6a51fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Creating volume 2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:00:33 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:33 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 1073741824
Jul 19 20:00:33 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:33 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 1073741824" returned: 0 in 0.404s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:33 devstack sudo[103445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6
Jul 19 20:00:33 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:34 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6" returned: 0 in 0.234s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Attempting download of 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab ((None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}])) to volume 2c7ba9f0-b9bd-428a-901f-1de1e446cfa6. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc67ae26-de09-4f75-9e2d-56cf87746f27]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_x_ompx7i {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:34 devstack sudo[103448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_x_ompx7i
Jul 19 20:00:34 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:34 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_x_ompx7i" returned: 0 in 0.328s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_x_ompx7i {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:34 devstack sudo[103452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_x_ompx7i
Jul 19 20:00:34 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:34 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_x_ompx7i" returned: 1 in 0.320s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_x_ompx7i' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1751f5-7610-4ca8-b0c4-11fa741df713]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:00:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:35 devstack sudo[103456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD
Jul 19 20:00:35 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:35 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:35 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab was qcow2, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 20:00:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:35 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6
Jul 19 20:00:35 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:36 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6" returned: 0 in 1.533s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:36 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04ccd5bf-54a0-4240-992d-4a2c0a0cdcab_s876st05devstack@QuobyteHD, size 112.00 MB, duration 1.53 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 20:00:36 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Converted 112.00 MB image at 73.00 MB/s
Jul 19 20:00:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:00:36 devstack sudo[103472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 1G
Jul 19 20:00:36 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:00:37 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 1G" returned: 0 in 0.309s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Downloaded image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab ((None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}])) to volume 2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Temporary image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab for user 45ed1e8504464303b73ff12a6a51fa74 is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Marking volume 2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Copying metadata from image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab to 2c7ba9f0-b9bd-428a-901f-1de1e446cfa6. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Creating volume glance metadata for volume 2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 backed by image 04ccd5bf-54a0-4240-992d-4a2c0a0cdcab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c9a59b-330d-45c7-b803-522c34b88b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6', 'volume_size': 1, 'image_id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b655f6b5e05c4491a1db3a4c5a1f10a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04ccd5bf-54a0-4240-992d-4a2c0a0cdcab', 'created_at': datetime.datetime(2026, 7, 19, 17, 40, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 17, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ccd5bf-54a0-4240-992d-4a2c0a0cdcab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ccb6510>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf67b29f-329c-47c7-a638-6820b51f536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:00:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Volume volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 (2c7ba9f0-b9bd-428a-901f-1de1e446cfa6): created successfully
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf67b29f-329c-47c7-a638-6820b51f536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:00:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Flow 'volume_create_manager' (2c4c6347-6b91-4526-bc46-7eaead8e1211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:00:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5d4d33d3-29f5-4c4e-abf8-aeb009841e16 tempest-TestShelveInstance-553749626 None] Created volume successfully.
Jul 19 20:00:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e2c5ac40-575a-4435-baea-ec54483ae1d0 req-4ce62a47-0663-4a3d-865a-173d23d23fd2 tempest-TestShelveInstance-553749626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:00:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e2c5ac40-575a-4435-baea-ec54483ae1d0 req-4ce62a47-0663-4a3d-865a-173d23d23fd2 tempest-TestShelveInstance-553749626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:00:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-e2c5ac40-575a-4435-baea-ec54483ae1d0 req-4ce62a47-0663-4a3d-865a-173d23d23fd2 tempest-TestShelveInstance-553749626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:00:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-e2c5ac40-575a-4435-baea-ec54483ae1d0 req-4ce62a47-0663-4a3d-865a-173d23d23fd2 tempest-TestShelveInstance-553749626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59173e97-6f70-4553-b4ca-71e586f597b9', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 20:00:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-e2c5ac40-575a-4435-baea-ec54483ae1d0 req-4ce62a47-0663-4a3d-865a-173d23d23fd2 tempest-TestShelveInstance-553749626 None] attachment_update completed successfully.
Jul 19 20:00:50 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:00:50 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:INSERT=8 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:01:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-ab1cfe1b-95d9-4bf6-884a-4e4477302b4a req-0d5dcee3-6aea-4d69-bad0-8a15cc798ee9 tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-ab1cfe1b-95d9-4bf6-884a-4e4477302b4a req-0d5dcee3-6aea-4d69-bad0-8a15cc798ee9 tempest-TestStampPattern-1113286556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:00 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb140c7-ed30-47cc-a9c3-6342c082d542]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-ab1cfe1b-95d9-4bf6-884a-4e4477302b4a req-0d5dcee3-6aea-4d69-bad0-8a15cc798ee9 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:00 devstack sudo[103973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29
Jul 19 20:01:00 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:00 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-ab1cfe1b-95d9-4bf6-884a-4e4477302b4a req-0d5dcee3-6aea-4d69-bad0-8a15cc798ee9 tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29" returned: 0 in 0.367s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-ab1cfe1b-95d9-4bf6-884a-4e4477302b4a req-0d5dcee3-6aea-4d69-bad0-8a15cc798ee9 tempest-TestStampPattern-1113286556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.391s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-ab1cfe1b-95d9-4bf6-884a-4e4477302b4a req-0d5dcee3-6aea-4d69-bad0-8a15cc798ee9 tempest-TestStampPattern-1113286556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-db8427ba-d550-424d-80f8-53ed88142e29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44671242-61fd-43d7-b353-0eeccea6ddbf', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 20:01:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-ab1cfe1b-95d9-4bf6-884a-4e4477302b4a req-0d5dcee3-6aea-4d69-bad0-8a15cc798ee9 tempest-TestStampPattern-1113286556 None] attachment_update completed successfully.
Jul 19 20:01:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-1db549bf-6d91-48bd-bbb9-31b75ff6eedd req-b366ed13-3550-4329-936a-14d0bfe15b21 tempest-TestStampPattern-1113286556 None] Terminate volume connection completed successfully.
Jul 19 20:01:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-1db549bf-6d91-48bd-bbb9-31b75ff6eedd req-b366ed13-3550-4329-936a-14d0bfe15b21 tempest-TestStampPattern-1113286556 None] Deleting attachment 44671242-61fd-43d7-b353-0eeccea6ddbf. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 20:01:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-db8427ba-d550-424d-80f8-53ed88142e29-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Lock "cinder-db8427ba-d550-424d-80f8-53ed88142e29-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-quobyte-db8427ba-d550-424d-80f8-53ed88142e29" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-db8427ba-d550-424d-80f8-53ed88142e29" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:07 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[007e5bb6-cf8f-41ad-a76a-e92c63b86812]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:07 devstack sudo[104054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29
Jul 19 20:01:07 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:08 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29" returned: 0 in 0.356s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:08 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29
Jul 19 20:01:08 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:08 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-db8427ba-d550-424d-80f8-53ed88142e29" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-db8427ba-d550-424d-80f8-53ed88142e29" released by "delete_volume" :: held 0.654s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Created reservations ['4c9db8ed-20cd-4371-ac98-f285b2ef2e5a', 'e5cf103d-61ba-4637-a10b-f67228a9ad92', '2764be66-e4a1-4cd5-a00f-21333ceb1a9c', '5e9af2be-48d9-41dd-abec-4157ccc23867'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:08 devstack sudo[104070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:08 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:08 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.282s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Deleted volume successfully.
Jul 19 20:01:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-daf2e7a7-5919-478e-98a5-bf524f467278 tempest-TestStampPattern-1113286556 None] Lock "cinder-db8427ba-d550-424d-80f8-53ed88142e29-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-9f5d9391-20ab-4e70-a731-9fca60063629-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Lock "cinder-9f5d9391-20ab-4e70-a731-9fca60063629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-quobyte-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-quobyte-9f5d9391-20ab-4e70-a731-9fca60063629" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-9f5d9391-20ab-4e70-a731-9fca60063629" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Deleting offline snapshot 9f5d9391-20ab-4e70-a731-9fca60063629 of volume 10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] snapshot_file for this snap is: volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccadb825-951a-41c1-a098-471a989dc228]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:09 devstack sudo[104073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629
Jul 19 20:01:09 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:09 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629" returned: 0 in 0.363s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[745f58a1-25f8-4942-9455-5dde6fc847e6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:09 devstack sudo[104078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c
Jul 19 20:01:09 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:09 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" returned: 0 in 0.352s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:10 devstack sudo[104083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629
Jul 19 20:01:10 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:10 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629" returned: 0 in 0.370s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:10 devstack sudo[104091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629
Jul 19 20:01:10 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:10 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c.9f5d9391-20ab-4e70-a731-9fca60063629" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-9f5d9391-20ab-4e70-a731-9fca60063629" released by "_delete_snapshot" :: held 1.456s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" released by "delete_snapshot" :: held 1.478s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:10 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Created reservations ['c125c920-b246-4566-95dd-09b9f135c6a3', 'fb7f84d1-7650-4aa6-814a-64cff04d08a5', '730df85b-0456-488f-a7ce-617bedaa23c6', '3dc8789b-79c7-4951-a2a4-cd9776d5ba55'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Delete snapshot completed successfully.
Jul 19 20:01:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e52001eb-cdd0-4213-b454-6a11ab41b58d tempest-TestStampPattern-1113286556 None] Lock "cinder-9f5d9391-20ab-4e70-a731-9fca60063629-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-7fcd48d9-1fc3-4ee3-afd7-4e74086b5439 req-ceac3c0f-6136-4c65-9e57-164542f8b3c2 tempest-TestShelveInstance-553749626 None] Terminate volume connection completed successfully.
Jul 19 20:01:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-7fcd48d9-1fc3-4ee3-afd7-4e74086b5439 req-ceac3c0f-6136-4c65-9e57-164542f8b3c2 tempest-TestShelveInstance-553749626 None] Deleting attachment 59173e97-6f70-4553-b4ca-71e586f597b9. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-10a6f204-6bc1-4b96-84ff-36cfcb583a5c-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Lock "cinder-10a6f204-6bc1-4b96-84ff-36cfcb583a5c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Acquiring lock "cinder-quobyte-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00e7df7-bdb4-4af9-8564-af7cb7d6cfb5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:15 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c
Jul 19 20:01:15 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-d4e08d79-921e-4d6b-9064-0f6d9994f8e9 req-eb80f2e9-d148-460c-b565-6062a91ab7ca tempest-TestShelveInstance-553749626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-d4e08d79-921e-4d6b-9064-0f6d9994f8e9 req-eb80f2e9-d148-460c-b565-6062a91ab7ca tempest-TestShelveInstance-553749626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-d4e08d79-921e-4d6b-9064-0f6d9994f8e9 req-eb80f2e9-d148-460c-b565-6062a91ab7ca tempest-TestShelveInstance-553749626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-d4e08d79-921e-4d6b-9064-0f6d9994f8e9 req-eb80f2e9-d148-460c-b565-6062a91ab7ca tempest-TestShelveInstance-553749626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237', 'name': 'volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61fe964e-5edf-4061-9f47-8542cea44caa', 'enforce_multipath': True} {{(pid=87353) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 19 20:01:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-d4e08d79-921e-4d6b-9064-0f6d9994f8e9 req-eb80f2e9-d148-460c-b565-6062a91ab7ca tempest-TestShelveInstance-553749626 None] attachment_update completed successfully.
Jul 19 20:01:15 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" returned: 0 in 0.370s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:15 devstack sudo[104171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c
Jul 19 20:01:15 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:15 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" returned: 0 in 0.278s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Lock "cinder-quobyte-10a6f204-6bc1-4b96-84ff-36cfcb583a5c" released by "delete_volume" :: held 0.715s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Created reservations ['3e670c9a-cbd8-4eed-be1a-c5730c6630d0', '8b727df0-6c87-4174-a434-6460ef24c575', '906f790f-915f-4263-a182-04be46ef280a', '16d43bdb-f85b-49b2-8333-f9f03865c2a5'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:16 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:16 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:16 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.262s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:16 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Deleted volume successfully.
Jul 19 20:01:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ecde3bb4-a281-4904-bd38-366561e9bdd5 tempest-TestStampPattern-1113286556 None] Lock "cinder-10a6f204-6bc1-4b96-84ff-36cfcb583a5c-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:26 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=31,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:01:26 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=31,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (3839246b-e04f-43c7-9daa-2f2c34039a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00126bf4-7395-4b6d-b998-68053ff4f6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00126bf4-7395-4b6d-b998-68053ff4f6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1100639015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:28Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2958552-df15-427d-89ee-9fb383ee8fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2958552-df15-427d-89ee-9fb383ee8fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abeb91d1-2df8-4075-997f-7bf95c093d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abeb91d1-2df8-4075-997f-7bf95c093d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4', 'volume_name': 'volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addab977-5227-4965-b34d-b8933be0b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addab977-5227-4965-b34d-b8933be0b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39159a5-3436-4b15-8f6d-1c3f45a1cdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:28 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume 7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4', 'volume_size': 1}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1100639015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:28Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Creating volume 7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:28 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:28 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 1073741824
Jul 19 20:01:28 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:28 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 1073741824" returned: 0 in 0.429s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:28 devstack sudo[104672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4
Jul 19 20:01:28 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:28 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" returned: 0 in 0.260s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39159a5-3436-4b15-8f6d-1c3f45a1cdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd68fa2-c440-4764-9800-de000e5b20a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:28 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 (7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4): created successfully
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd68fa2-c440-4764-9800-de000e5b20a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (3839246b-e04f-43c7-9daa-2f2c34039a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-33c8f230-5317-4086-81f3-c2686d07c786 tempest-CreateVolumesFromSnapshotTest-381837912 None] Created volume successfully.
Jul 19 20:01:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Creating offline snapshot 718d9cc3-e5cc-41ca-9623-53548bfebd43 of volume 7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:01:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd647fd0-ef88-4b45-95b2-7d19d3ca7625]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:29 devstack sudo[104675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4
Jul 19 20:01:29 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:29 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" returned: 0 in 0.368s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:29 devstack sudo[104680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 1G
Jul 19 20:01:29 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:30 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 1G" returned: 0 in 0.408s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:30 devstack sudo[104685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43
Jul 19 20:01:30 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:30 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43" returned: 0 in 0.294s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:30 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 is being set with open permissions: ugo+rw
Jul 19 20:01:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:30 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43
Jul 19 20:01:30 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:30 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43" returned: 0 in 0.252s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:30 devstack sudo[104693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.info
Jul 19 20:01:30 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:30 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.info" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:30 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.info is being set with open permissions: ugo+rw
Jul 19 20:01:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:30 devstack sudo[104696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.info
Jul 19 20:01:30 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:31 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.info" returned: 0 in 0.244s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-20c879aa-00b2-46b9-8558-da5f9369e999 tempest-CreateVolumesFromSnapshotTest-381837912 None] Create snapshot completed successfully
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (9da36c47-70e9-4263-af69-f04eaa7b35ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d046a02-b38b-4824-90d3-626305953d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d046a02-b38b-4824-90d3-626305953d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1430153938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31832316-b6a0-4621-bcb0-9f9ceb0ce91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:32Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6c555d-e4ba-479d-ae57-0723f4eec094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6c555d-e4ba-479d-ae57-0723f4eec094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328a3f25-2cb4-41e1-90c8-9ba7d6116e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328a3f25-2cb4-41e1-90c8-9ba7d6116e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31832316-b6a0-4621-bcb0-9f9ceb0ce91f', 'volume_name': 'volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4a9a59-4a7e-4360-bfeb-1747855d84c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4a9a59-4a7e-4360-bfeb-1747855d84c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eedf812-5318-4cfb-bbc2-ba47ec0683fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:31 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume 31832316-b6a0-4621-bcb0-9f9ceb0ce91f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f', 'volume_size': 1}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1430153938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31832316-b6a0-4621-bcb0-9f9ceb0ce91f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:32Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Creating volume 31832316-b6a0-4621-bcb0-9f9ceb0ce91f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:31 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:31 devstack sudo[104699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f 1073741824
Jul 19 20:01:31 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (a1857672-0a4c-4b5f-833b-7d3ddd849680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ec7692-4e8e-4e31-a758-8cd9e3361c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ec7692-4e8e-4e31-a758-8cd9e3361c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085366597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddf3298-a31c-4302-80c0-f355c4ac250d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:32Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6a4d90-528c-4f5b-99bb-3e052d7fb449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6a4d90-528c-4f5b-99bb-3e052d7fb449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e3a543-d948-41fe-a0a8-6e3c5525bf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e3a543-d948-41fe-a0a8-6e3c5525bf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cddf3298-a31c-4302-80c0-f355c4ac250d', 'volume_name': 'volume-cddf3298-a31c-4302-80c0-f355c4ac250d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eea8902-c742-4674-bd3b-b13b82c709ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eea8902-c742-4674-bd3b-b13b82c709ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8605658f-2a5b-44a3-87c0-6edcd755bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume cddf3298-a31c-4302-80c0-f355c4ac250d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cddf3298-a31c-4302-80c0-f355c4ac250d', 'volume_size': 1}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:32 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f 1073741824" returned: 0 in 0.600s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:32 devstack sudo[104711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f
Jul 19 20:01:32 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (858b2f00-07ad-4b2b-94d9-55c61f63c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef31b66-7fbb-4407-81cf-d787e86ed4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:32 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef31b66-7fbb-4407-81cf-d787e86ed4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101398907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048a6c28-a26c-4db4-bad0-9d9ed718615c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:33Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:32 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:32 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ef9d50-b321-4469-9040-8f0be76f7032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ef9d50-b321-4469-9040-8f0be76f7032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d531cc94-8b0f-4a42-aa5e-6f30375f44c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d531cc94-8b0f-4a42-aa5e-6f30375f44c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048a6c28-a26c-4db4-bad0-9d9ed718615c', 'volume_name': 'volume-048a6c28-a26c-4db4-bad0-9d9ed718615c', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d4cb2f-bce0-4280-b32c-bcc36b84034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d4cb2f-bce0-4280-b32c-bcc36b84034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6b1eb3-1435-4db6-99ea-82d1f46c1369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume 048a6c28-a26c-4db4-bad0-9d9ed718615c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048a6c28-a26c-4db4-bad0-9d9ed718615c', 'volume_size': 1}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f" returned: 0 in 0.392s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085366597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddf3298-a31c-4302-80c0-f355c4ac250d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:32Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Creating volume cddf3298-a31c-4302-80c0-f355c4ac250d {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:32 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eedf812-5318-4cfb-bbc2-ba47ec0683fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dc36dd-09df-41af-ad2c-9686831142b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f (31832316-b6a0-4621-bcb0-9f9ceb0ce91f): created successfully
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dc36dd-09df-41af-ad2c-9686831142b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d 1073741824
Jul 19 20:01:33 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (9da36c47-70e9-4263-af69-f04eaa7b35ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f2962d43-4d03-4a8d-885c-69a61d829f2f tempest-CreateVolumesFromSnapshotTest-381837912 None] Created volume successfully.
Jul 19 20:01:33 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.569s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (313429d0-6863-4abd-8184-c1059147eef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767ae7f7-234e-4195-9d29-ad5b67e6a6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767ae7f7-234e-4195-9d29-ad5b67e6a6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-408375875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe112fec-0908-493f-b3c7-c216912a9016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:33Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d70131-0d98-4c68-8d8f-e6c274b956cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d70131-0d98-4c68-8d8f-e6c274b956cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b04702-9a4d-4bfa-9ca1-b1c53df7a576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b04702-9a4d-4bfa-9ca1-b1c53df7a576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe112fec-0908-493f-b3c7-c216912a9016', 'volume_name': 'volume-fe112fec-0908-493f-b3c7-c216912a9016', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78de7540-b964-4652-a2de-e64da372a31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78de7540-b964-4652-a2de-e64da372a31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cff2f30-cf37-4ea2-b31f-5dc24c34e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume fe112fec-0908-493f-b3c7-c216912a9016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe112fec-0908-493f-b3c7-c216912a9016', 'volume_size': 1}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:33 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d 1073741824" returned: 0 in 0.729s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:33 devstack sudo[104735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d
Jul 19 20:01:33 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (565d2a8c-da2b-4ea1-8e6a-37074c8a4d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f00f6c-bc9c-403d-8214-4a5b10c16592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f00f6c-bc9c-403d-8214-4a5b10c16592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959596167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c1dd67-6dc6-4973-9ea6-83a2e1ff8437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:34Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec466fd-b215-40f9-8779-0a809bc99f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec466fd-b215-40f9-8779-0a809bc99f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc753e8c-3c68-41f6-9f36-f05bb5d91a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc753e8c-3c68-41f6-9f36-f05bb5d91a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c1dd67-6dc6-4973-9ea6-83a2e1ff8437', 'volume_name': 'volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159317cb-1dd0-4e93-8825-4b0e56114ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159317cb-1dd0-4e93-8825-4b0e56114ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f278b4a3-afa7-4799-884b-f1d055f1f402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume 60c1dd67-6dc6-4973-9ea6-83a2e1ff8437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437', 'volume_size': 1}
Jul 19 20:01:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:34 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d" returned: 0 in 0.281s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.076s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101398907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048a6c28-a26c-4db4-bad0-9d9ed718615c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:33Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Creating volume 048a6c28-a26c-4db4-bad0-9d9ed718615c {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:34 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8605658f-2a5b-44a3-87c0-6edcd755bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cddf3298-a31c-4302-80c0-f355c4ac250d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdeddd0-8970-4896-b659-2caeca1c24cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:34 devstack sudo[104739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c 1073741824
Jul 19 20:01:34 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume volume-cddf3298-a31c-4302-80c0-f355c4ac250d (cddf3298-a31c-4302-80c0-f355c4ac250d): created successfully
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdeddd0-8970-4896-b659-2caeca1c24cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (a1857672-0a4c-4b5f-833b-7d3ddd849680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-44f9c15d-5668-423a-bfff-1fcacca3675b tempest-CreateVolumesFromSnapshotTest-381837912 None] Created volume successfully.
Jul 19 20:01:34 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c 1073741824" returned: 0 in 0.447s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:34 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c
Jul 19 20:01:34 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:34 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-408375875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe112fec-0908-493f-b3c7-c216912a9016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:33Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Creating volume fe112fec-0908-493f-b3c7-c216912a9016 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:34 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6b1eb3-1435-4db6-99ea-82d1f46c1369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048a6c28-a26c-4db4-bad0-9d9ed718615c', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9cfb64-7290-42a7-b1cb-695601ca9bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:34 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016 1073741824
Jul 19 20:01:34 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:34 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume volume-048a6c28-a26c-4db4-bad0-9d9ed718615c (048a6c28-a26c-4db4-bad0-9d9ed718615c): created successfully
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9cfb64-7290-42a7-b1cb-695601ca9bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (858b2f00-07ad-4b2b-94d9-55c61f63c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-78f44b68-5543-468d-920d-c251c3869e0e tempest-CreateVolumesFromSnapshotTest-381837912 None] Created volume successfully.
Jul 19 20:01:35 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016 1073741824" returned: 0 in 0.416s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:35 devstack sudo[104754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016
Jul 19 20:01:35 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:35 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016" returned: 0 in 0.247s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959596167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c1dd67-6dc6-4973-9ea6-83a2e1ff8437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca47181c46894b8da79a4921e1263c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:34Z,use_quota=True,user_id='415068311aaf4c79bd294facd5c1d39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Creating volume 60c1dd67-6dc6-4973-9ea6-83a2e1ff8437 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:35 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:35 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437 1073741824
Jul 19 20:01:35 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cff2f30-cf37-4ea2-b31f-5dc24c34e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe112fec-0908-493f-b3c7-c216912a9016', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a94f54-d8db-4813-9645-b542d9effa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:35 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume volume-fe112fec-0908-493f-b3c7-c216912a9016 (fe112fec-0908-493f-b3c7-c216912a9016): created successfully
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a94f54-d8db-4813-9645-b542d9effa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (313429d0-6863-4abd-8184-c1059147eef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:35 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-dc3c75c9-6f21-4a03-9cfc-daa72c2dfed1 tempest-CreateVolumesFromSnapshotTest-381837912 None] Created volume successfully.
Jul 19 20:01:35 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437 1073741824" returned: 0 in 0.420s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:35 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437
Jul 19 20:01:35 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:36 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437" returned: 0 in 0.247s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f278b4a3-afa7-4799-884b-f1d055f1f402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15a716a-9e12-4eb2-9772-285282ced829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:36 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Volume volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437 (60c1dd67-6dc6-4973-9ea6-83a2e1ff8437): created successfully
Jul 19 20:01:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15a716a-9e12-4eb2-9772-285282ced829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Flow 'volume_create_manager' (565d2a8c-da2b-4ea1-8e6a-37074c8a4d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-aa1ac322-1e4c-4991-884f-70f6196c8d19 tempest-CreateVolumesFromSnapshotTest-381837912 None] Created volume successfully.
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-quobyte-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb5d0de-89c3-4c36-b708-113d7781aa8a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:37 devstack sudo[104767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437
Jul 19 20:01:37 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:37 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437" returned: 0 in 0.358s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:37 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437
Jul 19 20:01:37 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:37 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437" returned: 0 in 0.244s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437" released by "delete_volume" :: held 0.645s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Created reservations ['30ef273a-f17b-4dcb-9661-91f3ff69e52a', '0a1c5237-26bd-4e57-9927-757082096fdc', 'bbea4307-716b-4c68-9d66-7e50421e1875', 'c6b44ade-c2df-48dc-b74a-22d5c2357f63'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:37 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:37 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:38 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Deleted volume successfully.
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b6eb4d8d-09e2-4886-b554-8386deecd28c tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-60c1dd67-6dc6-4973-9ea6-83a2e1ff8437-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-fe112fec-0908-493f-b3c7-c216912a9016-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-fe112fec-0908-493f-b3c7-c216912a9016-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-quobyte-fe112fec-0908-493f-b3c7-c216912a9016" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-fe112fec-0908-493f-b3c7-c216912a9016" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e89d78c-ab1f-4135-ad28-fdff1562c1e2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:38 devstack sudo[104802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016
Jul 19 20:01:38 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:38 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016" returned: 0 in 0.349s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:38 devstack sudo[104807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016
Jul 19 20:01:38 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:38 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fe112fec-0908-493f-b3c7-c216912a9016" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-fe112fec-0908-493f-b3c7-c216912a9016" released by "delete_volume" :: held 0.626s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Created reservations ['f1e2781d-100c-442f-9c33-87fe72315cad', '95512b7b-ea70-4e3a-8ee6-b86c39f08c91', '16dc06f1-1122-4f24-b9c4-ea46d83b669d', 'db1461a8-abbf-4039-8e55-a2e008cb5b84'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:39 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:39 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:39 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Deleted volume successfully.
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59fcee21-c41b-4c1d-b1c8-4702db451854 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-fe112fec-0908-493f-b3c7-c216912a9016-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-048a6c28-a26c-4db4-bad0-9d9ed718615c-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-048a6c28-a26c-4db4-bad0-9d9ed718615c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-quobyte-048a6c28-a26c-4db4-bad0-9d9ed718615c" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-048a6c28-a26c-4db4-bad0-9d9ed718615c" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1333cd-24d4-4355-b595-c3a07da9b0ce]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:39 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c
Jul 19 20:01:39 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:39 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c" returned: 0 in 0.361s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:39 devstack sudo[104818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c
Jul 19 20:01:39 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:40 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-048a6c28-a26c-4db4-bad0-9d9ed718615c" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-048a6c28-a26c-4db4-bad0-9d9ed718615c" released by "delete_volume" :: held 0.640s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Created reservations ['e8a6bd25-1a0c-4e29-b513-00d16eaaaf36', '3ed5ba86-665b-4361-b885-e3215f39a0f4', 'cbbb3b10-2b6d-467b-a583-0b765bae7b15', '45fe611e-1aea-43db-afb1-1863caadcc59'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:40 devstack sudo[104821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:40 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:40 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.268s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Deleted volume successfully.
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c10543d1-d47e-41aa-a2c2-e3af0b1f4a8f tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-048a6c28-a26c-4db4-bad0-9d9ed718615c-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-cddf3298-a31c-4302-80c0-f355c4ac250d-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-cddf3298-a31c-4302-80c0-f355c4ac250d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-quobyte-cddf3298-a31c-4302-80c0-f355c4ac250d" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-cddf3298-a31c-4302-80c0-f355c4ac250d" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e1246c-76e6-40ba-9bf1-302b7a19b054]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:41 devstack sudo[104824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d
Jul 19 20:01:41 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:41 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d" returned: 0 in 0.399s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:41 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d
Jul 19 20:01:41 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:41 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-cddf3298-a31c-4302-80c0-f355c4ac250d" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-cddf3298-a31c-4302-80c0-f355c4ac250d" released by "delete_volume" :: held 0.703s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Created reservations ['43d3d3b4-f055-4930-9ff8-88609714b591', '88332b6f-7866-43b9-9622-eb2e9781f7da', '94475d39-7ff9-471c-b70c-ec42ea2b76d4', 'beacc2db-47ad-4d9d-a771-c93b4b6fd0d2'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:41 devstack sudo[104834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:41 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:42 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-31832316-b6a0-4621-bcb0-9f9ceb0ce91f-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.268s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Deleted volume successfully.
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-31832316-b6a0-4621-bcb0-9f9ceb0ce91f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3c4676c6-610a-4e84-ab8e-015899e3bfce tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-cddf3298-a31c-4302-80c0-f355c4ac250d-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-quobyte-31832316-b6a0-4621-bcb0-9f9ceb0ce91f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-31832316-b6a0-4621-bcb0-9f9ceb0ce91f" acquired by "delete_volume" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf0c5e5-469a-45c2-a943-d76739d850da]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:42 devstack sudo[104837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f
Jul 19 20:01:42 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:42 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f" returned: 0 in 0.364s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:42 devstack sudo[104843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f
Jul 19 20:01:42 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:42 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-31832316-b6a0-4621-bcb0-9f9ceb0ce91f" returned: 0 in 0.236s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-31832316-b6a0-4621-bcb0-9f9ceb0ce91f" released by "delete_volume" :: held 0.641s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Created reservations ['95fab7bc-1345-4067-873d-b4a62a31084c', 'a04d9fae-6ced-4803-a17c-f5106cdac4d1', '1fd065c3-62ed-46a2-878d-8a5785bb833a', '99663653-d750-4713-bb36-60f899256469'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:42 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:42 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:43 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:43 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Deleted volume successfully.
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e7693e40-1ace-4021-b3f9-bd6d2c6bda4b tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-31832316-b6a0-4621-bcb0-9f9ceb0ce91f-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-718d9cc3-e5cc-41ca-9623-53548bfebd43-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-718d9cc3-e5cc-41ca-9623-53548bfebd43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-quobyte-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-quobyte-718d9cc3-e5cc-41ca-9623-53548bfebd43" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-718d9cc3-e5cc-41ca-9623-53548bfebd43" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Deleting offline snapshot 718d9cc3-e5cc-41ca-9623-53548bfebd43 of volume 7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] snapshot_file for this snap is: volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb954929-0823-44e2-b7d2-3f6f482b3284]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:43 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43
Jul 19 20:01:43 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:43 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43" returned: 0 in 0.354s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5515ebaa-ac1e-4836-9b5e-d37fe755c5ca]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:43 devstack sudo[104858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4
Jul 19 20:01:43 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:44 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" returned: 0 in 0.372s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:44 devstack sudo[104864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43
Jul 19 20:01:44 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:44 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43" returned: 0 in 0.429s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:44 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43
Jul 19 20:01:44 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:44 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4.718d9cc3-e5cc-41ca-9623-53548bfebd43" returned: 0 in 0.323s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-718d9cc3-e5cc-41ca-9623-53548bfebd43" released by "_delete_snapshot" :: held 1.584s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" released by "delete_snapshot" :: held 1.610s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:44 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Created reservations ['5076cfb5-0ca8-46c2-9ffb-892856b4ac56', '667f5001-6ebb-4155-87b9-e183c1ccdac2', 'fffe50a8-bfdd-4ce5-a8f0-45122016a04a', '91d2238c-7a54-403a-9bad-6ae8b216bf4f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:45 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Delete snapshot completed successfully.
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-065b3e1b-8232-4140-85c4-821ca4f04b1d tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-718d9cc3-e5cc-41ca-9623-53548bfebd43-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "cinder-quobyte-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0221c5-3628-430b-8f88-323812d8cead]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:45 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4
Jul 19 20:01:45 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:45 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" returned: 0 in 0.377s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:45 devstack sudo[104903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4
Jul 19 20:01:45 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:46 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-quobyte-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4" released by "delete_volume" :: held 0.743s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Created reservations ['e5459c27-a05f-4943-995c-208697a18882', 'ec2d2a3d-cceb-40fe-9b7e-b2ab68c597d1', '8f5558cd-c318-448c-b47f-3af39dc67830', '927fed97-cd2a-4309-9aaf-8c5e6ebffeda'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-194f3b16-9300-404d-a799-36452d2d5886 req-613afd3f-d37c-487b-923b-97096857dd51 tempest-TestShelveInstance-553749626 None] Terminate volume connection completed successfully.
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [req-194f3b16-9300-404d-a799-36452d2d5886 req-613afd3f-d37c-487b-923b-97096857dd51 tempest-TestShelveInstance-553749626 None] Deleting attachment 61fe964e-5edf-4061-9f47-8542cea44caa. {{(pid=87353) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:46 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:46 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Acquiring lock "cinder-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Lock "cinder-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Acquiring lock "cinder-quobyte-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Lock "cinder-quobyte-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[29322d4f-5012-40ee-83bd-6a66985aa6f6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:46 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.291s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Deleted volume successfully.
Jul 19 20:01:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-07c5a5aa-254c-4d07-b650-339787944e28 tempest-CreateVolumesFromSnapshotTest-381837912 None] Lock "cinder-7d30ed2e-c857-4ccc-bebf-2f6d2e59f7f4-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:46 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6
Jul 19 20:01:46 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:47 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6" returned: 0 in 0.434s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:47 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6
Jul 19 20:01:47 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:47 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6" returned: 0 in 0.273s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Lock "cinder-quobyte-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6" released by "delete_volume" :: held 0.774s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG cinder.quota [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Created reservations ['4af5f64e-01c1-49a6-8c36-b894d974cf30', '82fae6a6-0426-4d09-84bd-377f58ccfcd6', '2303b720-0011-4895-9b97-a623fd7653dd', 'cbd63430-8819-4f11-bf7b-e54dad60eabd'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:47 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:47 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:47 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.290s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG cinder.manager [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Deleted volume successfully.
Jul 19 20:01:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [req-194f3b16-9300-404d-a799-36452d2d5886 req-844f433d-d613-4813-91c8-a37204931324 tempest-TestShelveInstance-553749626 None] Lock "cinder-2c7ba9f0-b9bd-428a-901f-1de1e446cfa6-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Flow 'volume_create_manager' (b2c2c7ec-a4ed-4b12-a6e6-158b0ac61aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e97dc51-4452-4b7d-8846-6535778b5416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e97dc51-4452-4b7d-8846-6535778b5416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433362882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f35a43-5ba4-4d02-a98e-a3494fa41c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe00edf30ab41378d26886341204697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:51Z,use_quota=True,user_id='b50657d5b3e2467ab59163036806d1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1a3903-2815-4ba6-bdf8-369be229a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1a3903-2815-4ba6-bdf8-369be229a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fac0cfb-0e41-41a3-8ce7-95be01dd779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fac0cfb-0e41-41a3-8ce7-95be01dd779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f35a43-5ba4-4d02-a98e-a3494fa41c71', 'volume_name': 'volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3778aadc-ee0a-4f5e-9f23-a3a42389989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3778aadc-ee0a-4f5e-9f23-a3a42389989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d97eb39-1d30-4286-86f3-bcd613a6a311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:50 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Volume c5f35a43-5ba4-4d02-a98e-a3494fa41c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71', 'volume_size': 1}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433362882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f35a43-5ba4-4d02-a98e-a3494fa41c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe00edf30ab41378d26886341204697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:51Z,use_quota=True,user_id='b50657d5b3e2467ab59163036806d1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Creating volume c5f35a43-5ba4-4d02-a98e-a3494fa41c71 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:50 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:50 devstack sudo[104923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71 1073741824
Jul 19 20:01:50 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:51 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71 1073741824" returned: 0 in 0.472s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:51 devstack sudo[104929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71
Jul 19 20:01:51 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:51 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d97eb39-1d30-4286-86f3-bcd613a6a311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfc3a42-5c46-48c1-bb0e-bf1b989ffb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:51 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Volume volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71 (c5f35a43-5ba4-4d02-a98e-a3494fa41c71): created successfully
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfc3a42-5c46-48c1-bb0e-bf1b989ffb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Flow 'volume_create_manager' (b2c2c7ec-a4ed-4b12-a6e6-158b0ac61aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b7c0a4ea-0b54-47d3-9123-4569d5fc3c73 tempest-ProjectReaderTests-548669300 None] Created volume successfully.
Jul 19 20:01:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Acquiring lock "cinder-c5f35a43-5ba4-4d02-a98e-a3494fa41c71-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Lock "cinder-c5f35a43-5ba4-4d02-a98e-a3494fa41c71-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Acquiring lock "cinder-quobyte-c5f35a43-5ba4-4d02-a98e-a3494fa41c71" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:52 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Lock "cinder-quobyte-c5f35a43-5ba4-4d02-a98e-a3494fa41c71" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:52 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[38969ac2-f180-44ab-a42d-27552bebd67b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:53 devstack sudo[104934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71
Jul 19 20:01:53 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:53 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71" returned: 0 in 0.368s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:53 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71
Jul 19 20:01:53 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:53 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c5f35a43-5ba4-4d02-a98e-a3494fa41c71" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Lock "cinder-quobyte-c5f35a43-5ba4-4d02-a98e-a3494fa41c71" released by "delete_volume" :: held 0.662s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Created reservations ['1ae7797c-20d6-44c0-886a-189dcfa7bf50', '5656e56a-988d-4143-a91b-9651f0cfd10b', '6bd0781c-270e-4045-94de-62d1f4e24add', 'c718989a-978a-437d-8f9b-d70f7a012d8d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:53 devstack sudo[104942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:53 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:54 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:54 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Deleted volume successfully.
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-ce2afed8-c5a2-4b6a-a32a-b006aab71aeb tempest-ProjectReaderTests-548669300 None] Lock "cinder-c5f35a43-5ba4-4d02-a98e-a3494fa41c71-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Flow 'volume_create_manager' (16e1e32a-0b5c-4515-b37e-e10bffb7d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f4422b-ca65-4ced-9311-0f542bbf9991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f4422b-ca65-4ced-9311-0f542bbf9991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340474616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90d5e4d-6f27-45e3-83c0-508315f59602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe00edf30ab41378d26886341204697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:55Z,use_quota=True,user_id='b50657d5b3e2467ab59163036806d1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93f6283-5991-4949-a517-dfe828ac24f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93f6283-5991-4949-a517-dfe828ac24f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0840b0e-35b1-4575-b404-a1e3f7ff7869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0840b0e-35b1-4575-b404-a1e3f7ff7869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90d5e4d-6f27-45e3-83c0-508315f59602', 'volume_name': 'volume-d90d5e4d-6f27-45e3-83c0-508315f59602', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b393e42a-d25a-47a4-8ccc-cbeff0b8e83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b393e42a-d25a-47a4-8ccc-cbeff0b8e83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faccbdae-45ae-44d9-a64d-334777e7ed57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:54 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Volume d90d5e4d-6f27-45e3-83c0-508315f59602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90d5e4d-6f27-45e3-83c0-508315f59602', 'volume_size': 1}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340474616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90d5e4d-6f27-45e3-83c0-508315f59602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe00edf30ab41378d26886341204697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:55Z,use_quota=True,user_id='b50657d5b3e2467ab59163036806d1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Creating volume d90d5e4d-6f27-45e3-83c0-508315f59602 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:54 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:54 devstack sudo[104946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602 1073741824
Jul 19 20:01:54 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:55 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602 1073741824" returned: 0 in 0.471s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:55 devstack sudo[104953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602
Jul 19 20:01:55 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:55 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faccbdae-45ae-44d9-a64d-334777e7ed57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90d5e4d-6f27-45e3-83c0-508315f59602', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357552c2-164f-4ec9-aaaf-cde0ec517637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:55 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Volume volume-d90d5e4d-6f27-45e3-83c0-508315f59602 (d90d5e4d-6f27-45e3-83c0-508315f59602): created successfully
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357552c2-164f-4ec9-aaaf-cde0ec517637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Flow 'volume_create_manager' (16e1e32a-0b5c-4515-b37e-e10bffb7d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:55 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-34f83010-dd03-4e58-9010-2928eb2d7dfd tempest-ProjectReaderTests-548669300 None] Created volume successfully.
Jul 19 20:01:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Acquiring lock "cinder-d90d5e4d-6f27-45e3-83c0-508315f59602-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Lock "cinder-d90d5e4d-6f27-45e3-83c0-508315f59602-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Acquiring lock "cinder-quobyte-d90d5e4d-6f27-45e3-83c0-508315f59602" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:01:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Lock "cinder-quobyte-d90d5e4d-6f27-45e3-83c0-508315f59602" acquired by "delete_volume" :: waited 0.012s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:01:56 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[df06cca2-7de0-4a6f-bc34-bcca23f5f91a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:01:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:56 devstack sudo[104956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602
Jul 19 20:01:56 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:57 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602" returned: 0 in 0.395s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:57 devstack sudo[104961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602
Jul 19 20:01:57 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:57 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-d90d5e4d-6f27-45e3-83c0-508315f59602" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Lock "cinder-quobyte-d90d5e4d-6f27-45e3-83c0-508315f59602" released by "delete_volume" :: held 0.686s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Created reservations ['4e9563bc-6241-4280-a2c7-eea778293e44', 'd54e58d0-e7a5-4222-b295-f176263ddf0f', 'fdf2f340-82c8-4d9c-8156-f9af04f8142b', '4ed07e6f-f274-4397-baf5-f9f932c8e2be'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:57 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:01:57 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:57 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:01:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Deleted volume successfully.
Jul 19 20:01:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aba5399e-1da7-427a-986c-ac1b84ad5ace tempest-ProjectReaderTests-548669300 None] Lock "cinder-d90d5e4d-6f27-45e3-83c0-508315f59602-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (9eb0a93d-de73-4a4a-9ef5-1cf02443c534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6292df52-efde-4935-b0e0-3c3592c43a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6292df52-efde-4935-b0e0-3c3592c43a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1478985096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb309935-4cbc-4d5b-ab9b-5214ba5c30fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:58Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5663c9-7f34-4bf9-8715-739bb169bb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5663c9-7f34-4bf9-8715-739bb169bb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4df014-a2d2-4d30-af21-ec5e04e24c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4df014-a2d2-4d30-af21-ec5e04e24c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb309935-4cbc-4d5b-ab9b-5214ba5c30fa', 'volume_name': 'volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ee43f6-b180-4f88-960a-608939a9a94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ee43f6-b180-4f88-960a-608939a9a94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfad48fc-8d82-447b-ad09-1b2613ba8f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:58 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Volume bb309935-4cbc-4d5b-ab9b-5214ba5c30fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa', 'volume_size': 1}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1478985096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb309935-4cbc-4d5b-ab9b-5214ba5c30fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:58Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Creating volume bb309935-4cbc-4d5b-ab9b-5214ba5c30fa {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:58 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:58 devstack sudo[104967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa 1073741824
Jul 19 20:01:58 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (ea6069a8-07c3-4f17-931e-981065b3c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ae2950-136c-4013-a1d3-a767f6f48c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ae2950-136c-4013-a1d3-a767f6f48c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193130267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693529e3-4f2c-40cb-bb27-f5a1772cc2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:59Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2c810c-62fc-43e8-9f09-fcebc6b48133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2c810c-62fc-43e8-9f09-fcebc6b48133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52fce99-f267-45ba-82c4-211a6a3da634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52fce99-f267-45ba-82c4-211a6a3da634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693529e3-4f2c-40cb-bb27-f5a1772cc2fc', 'volume_name': 'volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f95ccdb-8c81-48e1-b25d-b1f0e9d09a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f95ccdb-8c81-48e1-b25d-b1f0e9d09a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bfeb73-a729-4397-8bcb-50c12f85bb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Volume 693529e3-4f2c-40cb-bb27-f5a1772cc2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc', 'volume_size': 1}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:59 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa 1073741824" returned: 0 in 0.571s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:59 devstack sudo[104974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa
Jul 19 20:01:59 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (b36bfd86-a95f-4b60-9eb2-a0a0b2460228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b506c25-af4b-4481-928f-357303d69e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b506c25-af4b-4481-928f-357303d69e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219973465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b86c32c-8821-44e4-a3a3-1bb61e2e702f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:59Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7434598-9060-4896-bcd5-9ddd602ba674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7434598-9060-4896-bcd5-9ddd602ba674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5ecb97-12c5-4fd0-88f6-9477d5e3826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5ecb97-12c5-4fd0-88f6-9477d5e3826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b86c32c-8821-44e4-a3a3-1bb61e2e702f', 'volume_name': 'volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c753c4-9a62-46c7-a1b3-39a747c958b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c753c4-9a62-46c7-a1b3-39a747c958b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe82ee2e-2ad1-4ef5-916c-8e892c9da30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Volume 2b86c32c-8821-44e4-a3a3-1bb61e2e702f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f', 'volume_size': 1}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:59 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa" returned: 0 in 0.338s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193130267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693529e3-4f2c-40cb-bb27-f5a1772cc2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:59Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Creating volume 693529e3-4f2c-40cb-bb27-f5a1772cc2fc {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:01:59 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:01:59 devstack sudo[104977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc 1073741824
Jul 19 20:01:59 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfad48fc-8d82-447b-ad09-1b2613ba8f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee92039f-3a0d-44ae-aab6-5a3ac077fd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Volume volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa (bb309935-4cbc-4d5b-ab9b-5214ba5c30fa): created successfully
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee92039f-3a0d-44ae-aab6-5a3ac077fd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (9eb0a93d-de73-4a4a-9ef5-1cf02443c534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-30cc9acf-6ad1-4e61-afb4-b7e3311d31e5 tempest-CreateVolumesFromImageTest-1012129977 None] Created volume successfully.
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (fa27ea76-0d0e-4e5f-8eea-14647eddac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61f86cd-b963-4189-97b7-ec15cbc9fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61f86cd-b963-4189-97b7-ec15cbc9fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543554187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4302d506-64b9-46a8-a367-3e0e096a9a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:00Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80b913b-5973-48a4-b704-6bd776fa3981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80b913b-5973-48a4-b704-6bd776fa3981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493437b6-c219-45bc-8d22-85300e5dcee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493437b6-c219-45bc-8d22-85300e5dcee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4302d506-64b9-46a8-a367-3e0e096a9a10', 'volume_name': 'volume-4302d506-64b9-46a8-a367-3e0e096a9a10', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b521f7-fe31-4559-ad6d-af95f0850853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b521f7-fe31-4559-ad6d-af95f0850853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0677aa7-753c-423c-8fbb-9813f72430f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:01:59 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Volume 4302d506-64b9-46a8-a367-3e0e096a9a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4302d506-64b9-46a8-a367-3e0e096a9a10', 'volume_size': 1}
Jul 19 20:01:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:00 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc 1073741824" returned: 0 in 0.646s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (cb077708-c1ba-4206-aff6-7b776f9f7691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c462f57e-41e3-412f-90e9-9553d1d77ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c462f57e-41e3-412f-90e9-9553d1d77ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27693782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc60665-6f99-4afd-9b0e-83664a80ff7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:00Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112c4607-7464-44a8-818d-0258e6b37143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:00 devstack sudo[104983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc
Jul 19 20:02:00 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112c4607-7464-44a8-818d-0258e6b37143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6627c31-de63-4cb6-9525-dbc5f161742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6627c31-de63-4cb6-9525-dbc5f161742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc60665-6f99-4afd-9b0e-83664a80ff7e', 'volume_name': 'volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e7aac4-325c-48fb-a5fc-4906875796c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e7aac4-325c-48fb-a5fc-4906875796c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c19eb7-fffc-4675-83da-d8ab57205b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:00 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Volume 2dc60665-6f99-4afd-9b0e-83664a80ff7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e', 'volume_size': 1}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:00 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc" returned: 0 in 0.262s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.164s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219973465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b86c32c-8821-44e4-a3a3-1bb61e2e702f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:01:59Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Creating volume 2b86c32c-8821-44e4-a3a3-1bb61e2e702f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:00 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:00 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f 1073741824
Jul 19 20:02:00 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bfeb73-a729-4397-8bcb-50c12f85bb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bb6bb5-9fd4-4f48-81c1-f41a20fbf69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:00 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Volume volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc (693529e3-4f2c-40cb-bb27-f5a1772cc2fc): created successfully
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bb6bb5-9fd4-4f48-81c1-f41a20fbf69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (ea6069a8-07c3-4f17-931e-981065b3c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-81e1894f-0dd6-43ea-a4fd-6d991222298a tempest-CreateVolumesFromImageTest-1012129977 None] Created volume successfully.
Jul 19 20:02:01 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f 1073741824" returned: 0 in 0.429s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:01 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f
Jul 19 20:02:01 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:01 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f" returned: 0 in 0.252s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543554187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4302d506-64b9-46a8-a367-3e0e096a9a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:00Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Creating volume 4302d506-64b9-46a8-a367-3e0e096a9a10 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:01 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe82ee2e-2ad1-4ef5-916c-8e892c9da30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:01 devstack sudo[104995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10 1073741824
Jul 19 20:02:01 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b479d4-12da-47c2-ac18-8d7db079fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:01 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Volume volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f (2b86c32c-8821-44e4-a3a3-1bb61e2e702f): created successfully
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b479d4-12da-47c2-ac18-8d7db079fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (b36bfd86-a95f-4b60-9eb2-a0a0b2460228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:01 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f75b1226-ce5f-4dfe-ad65-673e09f7fa51 tempest-CreateVolumesFromImageTest-1012129977 None] Created volume successfully.
Jul 19 20:02:01 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10 1073741824" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:01 devstack sudo[105001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10
Jul 19 20:02:01 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:02 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10" returned: 0 in 0.269s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.676s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27693782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc60665-6f99-4afd-9b0e-83664a80ff7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75fc398858481b8e85e2d661ea8a76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:00Z,use_quota=True,user_id='73b785f0daf842e7aca94dabbdf3fe19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Creating volume 2dc60665-6f99-4afd-9b0e-83664a80ff7e {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:02 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0677aa7-753c-423c-8fbb-9813f72430f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4302d506-64b9-46a8-a367-3e0e096a9a10', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:02 devstack sudo[105004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e 1073741824
Jul 19 20:02:02 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a50b25-a486-458a-983e-b8c027daf818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Volume volume-4302d506-64b9-46a8-a367-3e0e096a9a10 (4302d506-64b9-46a8-a367-3e0e096a9a10): created successfully
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a50b25-a486-458a-983e-b8c027daf818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (fa27ea76-0d0e-4e5f-8eea-14647eddac95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-175bedf1-d010-4454-97d1-9a0b423360f0 tempest-CreateVolumesFromImageTest-1012129977 None] Created volume successfully.
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Flow 'volume_create_manager' (32713a6d-8854-40e7-916c-2df9751d252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc020d8-3139-40d0-9e7a-dfe438fa4c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc020d8-3139-40d0-9e7a-dfe438fa4c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329380196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a15d585-e99f-483b-9f90-b8956942b7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7664f122bfe342a5b096b9240bb0c376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:02Z,use_quota=True,user_id='8ca729fb165e413182aba15a9ebb69f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c3052b-7a6f-4c8a-8e25-79c6747994a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c3052b-7a6f-4c8a-8e25-79c6747994a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a630a2f-627a-4f21-958b-8c21c0f9504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a630a2f-627a-4f21-958b-8c21c0f9504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a15d585-e99f-483b-9f90-b8956942b7b1', 'volume_name': 'volume-6a15d585-e99f-483b-9f90-b8956942b7b1', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9afe1-19d4-41f4-a87e-7dc3ae1e81c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9afe1-19d4-41f4-a87e-7dc3ae1e81c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc3010d-067b-4a2a-b164-93303c5940a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Volume 6a15d585-e99f-483b-9f90-b8956942b7b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a15d585-e99f-483b-9f90-b8956942b7b1', 'volume_size': 1}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:02 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e 1073741824" returned: 0 in 0.442s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:02 devstack sudo[105010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e
Jul 19 20:02:02 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:02 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e" returned: 0 in 0.248s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329380196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a15d585-e99f-483b-9f90-b8956942b7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7664f122bfe342a5b096b9240bb0c376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:02Z,use_quota=True,user_id='8ca729fb165e413182aba15a9ebb69f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Creating volume 6a15d585-e99f-483b-9f90-b8956942b7b1 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:02 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c19eb7-fffc-4675-83da-d8ab57205b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1287a8c9-cf8e-4faa-b286-52dc04c0603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:02 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1 1073741824
Jul 19 20:02:02 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Volume volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e (2dc60665-6f99-4afd-9b0e-83664a80ff7e): created successfully
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1287a8c9-cf8e-4faa-b286-52dc04c0603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Flow 'volume_create_manager' (cb077708-c1ba-4206-aff6-7b776f9f7691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c0f4107f-97cf-42a1-9ca9-3af9285910a1 tempest-CreateVolumesFromImageTest-1012129977 None] Created volume successfully.
Jul 19 20:02:03 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1 1073741824" returned: 0 in 0.411s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:03 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1
Jul 19 20:02:03 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:03 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1" returned: 0 in 0.239s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc3010d-067b-4a2a-b164-93303c5940a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a15d585-e99f-483b-9f90-b8956942b7b1', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56340b9a-474d-4041-9d9c-1a36d6ba8e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:03 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Volume volume-6a15d585-e99f-483b-9f90-b8956942b7b1 (6a15d585-e99f-483b-9f90-b8956942b7b1): created successfully
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56340b9a-474d-4041-9d9c-1a36d6ba8e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Flow 'volume_create_manager' (32713a6d-8854-40e7-916c-2df9751d252e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f8e63537-f78a-4034-b17f-d0a7b44eb42f tempest-ProjectReaderTests-1417842400 None] Created volume successfully.
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-2dc60665-6f99-4afd-9b0e-83664a80ff7e-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-2dc60665-6f99-4afd-9b0e-83664a80ff7e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-quobyte-2dc60665-6f99-4afd-9b0e-83664a80ff7e" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-2dc60665-6f99-4afd-9b0e-83664a80ff7e" acquired by "delete_volume" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3a348b-01b8-4ffa-bd70-a8573ce7c878]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:03 devstack sudo[105022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e
Jul 19 20:02:03 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:04 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e" returned: 0 in 0.349s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:04 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e
Jul 19 20:02:04 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:04 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2dc60665-6f99-4afd-9b0e-83664a80ff7e" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-2dc60665-6f99-4afd-9b0e-83664a80ff7e" released by "delete_volume" :: held 0.638s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Created reservations ['9d05977a-43de-46a9-9ea1-f4b1bb4b018e', '930fed1f-799d-4e66-8bd5-4c6f2298685c', 'ec3dc863-238a-4ad1-9315-208e774e69b2', '95472ffe-cd76-44cc-8b9b-f81e9a47740d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "cinder-6a15d585-e99f-483b-9f90-b8956942b7b1-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:04 devstack sudo[105031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:04 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Lock "cinder-6a15d585-e99f-483b-9f90-b8956942b7b1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "cinder-quobyte-6a15d585-e99f-483b-9f90-b8956942b7b1" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Lock "cinder-quobyte-6a15d585-e99f-483b-9f90-b8956942b7b1" acquired by "delete_volume" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[73773dd3-90f1-422a-b543-409821e45fd2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:04 devstack sudo[105033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1
Jul 19 20:02:04 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:04 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.277s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:04 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Deleted volume successfully.
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-4c07e985-5a75-4bf4-9120-15bb64bde6ee tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-2dc60665-6f99-4afd-9b0e-83664a80ff7e-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-4302d506-64b9-46a8-a367-3e0e096a9a10-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-4302d506-64b9-46a8-a367-3e0e096a9a10-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-quobyte-4302d506-64b9-46a8-a367-3e0e096a9a10" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-4302d506-64b9-46a8-a367-3e0e096a9a10" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5277e51-11ba-4ddc-9c26-291f18e42620]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:04 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1" returned: 0 in 0.389s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:04 devstack sudo[105040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1
Jul 19 20:02:04 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:04 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10
Jul 19 20:02:04 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:05 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-6a15d585-e99f-483b-9f90-b8956942b7b1" returned: 0 in 0.251s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Lock "cinder-quobyte-6a15d585-e99f-483b-9f90-b8956942b7b1" released by "delete_volume" :: held 0.685s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:05 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10" returned: 0 in 0.375s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Created reservations ['108129c2-afe4-4ecb-b73c-19541371b035', '7f82e9b4-0fab-4999-b15d-90ac8b82110a', '03161b56-5acb-4a30-b2aa-6a1da260cec8', 'b21753c2-bf80-4d95-8b12-3118d6bb02e0'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:05 devstack sudo[105047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10
Jul 19 20:02:05 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:05 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:05 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:05 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4302d506-64b9-46a8-a367-3e0e096a9a10" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-4302d506-64b9-46a8-a367-3e0e096a9a10" released by "delete_volume" :: held 0.674s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Created reservations ['bb7e0dbb-eb21-461b-96ff-90e219c03276', '7ff6e815-a02a-48d8-9c6e-d27ba7475667', '59383f94-0750-49dd-834e-247094310e50', '1ad3987a-79f0-4030-8c7a-cad9c5981241'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:05 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.265s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:05 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Deleted volume successfully.
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-15bd9bef-265e-4318-b85a-668bd992db21 tempest-ProjectReaderTests-1417842400 None] Lock "cinder-6a15d585-e99f-483b-9f90-b8956942b7b1-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:05 devstack sudo[105053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:05 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:05 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.266s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:05 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Deleted volume successfully.
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-2b86c32c-8821-44e4-a3a3-1bb61e2e702f-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-eb5b2512-96b1-4c28-9e5c-5ae273461327 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-4302d506-64b9-46a8-a367-3e0e096a9a10-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-2b86c32c-8821-44e4-a3a3-1bb61e2e702f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-quobyte-2b86c32c-8821-44e4-a3a3-1bb61e2e702f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-2b86c32c-8821-44e4-a3a3-1bb61e2e702f" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea79c2b-2037-4e39-8b47-bc3f945758c6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Flow 'volume_create_manager' (665e9cae-0c6c-44ff-8cc9-95f62918db6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b918c5-7e7a-413a-8d8b-5a6505d22db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b918c5-7e7a-413a-8d8b-5a6505d22db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437729582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b61231-9101-4543-9674-e0593953a819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7664f122bfe342a5b096b9240bb0c376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:06Z,use_quota=True,user_id='8ca729fb165e413182aba15a9ebb69f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b2ebbd-b0f6-4b05-8d0e-d98f9d2856b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b2ebbd-b0f6-4b05-8d0e-d98f9d2856b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6febb773-9f78-4ccb-987d-0b41abe3f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6febb773-9f78-4ccb-987d-0b41abe3f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b61231-9101-4543-9674-e0593953a819', 'volume_name': 'volume-82b61231-9101-4543-9674-e0593953a819', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b219b3-3128-432a-99e7-603cfff51cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b219b3-3128-432a-99e7-603cfff51cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:06 devstack sudo[105056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f
Jul 19 20:02:06 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e22f6c4-fe44-4d40-ae8f-bf1e6cf19834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:06 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Volume 82b61231-9101-4543-9674-e0593953a819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b61231-9101-4543-9674-e0593953a819', 'volume_size': 1}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437729582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b61231-9101-4543-9674-e0593953a819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7664f122bfe342a5b096b9240bb0c376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:06Z,use_quota=True,user_id='8ca729fb165e413182aba15a9ebb69f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Creating volume 82b61231-9101-4543-9674-e0593953a819 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:06 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:06 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819 1073741824
Jul 19 20:02:06 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:06 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f" returned: 0 in 0.396s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:06 devstack sudo[105067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f
Jul 19 20:02:06 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:06 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819 1073741824" returned: 0 in 0.433s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:06 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819
Jul 19 20:02:06 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:06 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2b86c32c-8821-44e4-a3a3-1bb61e2e702f" returned: 0 in 0.268s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-2b86c32c-8821-44e4-a3a3-1bb61e2e702f" released by "delete_volume" :: held 0.707s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Created reservations ['82af003d-48fd-40b1-8d62-4bd917dafa29', 'e3ef10e5-fced-4d0e-9585-f434d4a45658', 'b616ab59-2641-4610-927b-3af597279881', 'd4fce26e-1966-40b5-8de4-4ad3c617c7c1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:06 devstack sudo[105073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:06 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:06 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e22f6c4-fe44-4d40-ae8f-bf1e6cf19834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b61231-9101-4543-9674-e0593953a819', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4256777b-9fc3-4773-913a-5b57af85786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:06 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Volume volume-82b61231-9101-4543-9674-e0593953a819 (82b61231-9101-4543-9674-e0593953a819): created successfully
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4256777b-9fc3-4773-913a-5b57af85786d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Flow 'volume_create_manager' (665e9cae-0c6c-44ff-8cc9-95f62918db6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:06 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-26e52e52-a14c-41b8-9b7b-f9b016b4aab5 tempest-ProjectReaderTests-1417842400 None] Created volume successfully.
Jul 19 20:02:07 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:07 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Deleted volume successfully.
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-693529e3-4f2c-40cb-bb27-f5a1772cc2fc-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Acquiring lock "cinder-82b61231-9101-4543-9674-e0593953a819-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-484a6070-7d11-4c76-9587-bbe80f8a2754 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-2b86c32c-8821-44e4-a3a3-1bb61e2e702f-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Lock "cinder-82b61231-9101-4543-9674-e0593953a819-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-693529e3-4f2c-40cb-bb27-f5a1772cc2fc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-quobyte-693529e3-4f2c-40cb-bb27-f5a1772cc2fc" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Acquiring lock "cinder-quobyte-82b61231-9101-4543-9674-e0593953a819" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-693529e3-4f2c-40cb-bb27-f5a1772cc2fc" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Lock "cinder-quobyte-82b61231-9101-4543-9674-e0593953a819" acquired by "delete_volume" :: waited 0.035s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6aced-bf1b-4afa-9b81-a2fa7e370b08]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0856090a-69ac-44b9-818d-f79a77f410c0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:07 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc
Jul 19 20:02:07 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:07 devstack sudo[105078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819
Jul 19 20:02:07 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:07 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc" returned: 0 in 0.362s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:07 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819" returned: 0 in 0.360s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:07 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc
Jul 19 20:02:07 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:07 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819
Jul 19 20:02:07 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:07 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-693529e3-4f2c-40cb-bb27-f5a1772cc2fc" returned: 0 in 0.245s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:07 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-82b61231-9101-4543-9674-e0593953a819" returned: 0 in 0.247s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-693529e3-4f2c-40cb-bb27-f5a1772cc2fc" released by "delete_volume" :: held 0.670s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Lock "cinder-quobyte-82b61231-9101-4543-9674-e0593953a819" released by "delete_volume" :: held 0.651s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Created reservations ['50886176-160a-490a-98f7-26401a568265', '7d81f503-73b2-4a43-870c-4cf16ec3e32b', '4ee189d6-25da-4edd-90b8-1376e03d53e2', '4a2c5fda-521b-4c4f-b6ff-3ac04d16ea84'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:07 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Created reservations ['60dc17a0-8067-4a02-a292-28a2a2a5d891', 'f9359f4e-bc37-438a-8208-b7d3559c549c', 'b5b68dab-962d-4645-8459-4002b0c86343', '8bea1716-a138-40a9-9344-b173d647bc81'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:08 devstack sudo[105093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:08 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:08 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:08 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:08 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.277s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Deleted volume successfully.
Jul 19 20:02:08 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3215df13-52eb-4307-85a7-185e3ce50c3e tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-693529e3-4f2c-40cb-bb27-f5a1772cc2fc-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Deleted volume successfully.
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-399e640e-b8a1-4f74-8aee-980a8fddc8af tempest-ProjectReaderTests-1417842400 None] Lock "cinder-82b61231-9101-4543-9674-e0593953a819-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "cinder-quobyte-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e55b191-fb69-4fdb-ab38-2962ffe59128]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:08 devstack sudo[105099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa
Jul 19 20:02:08 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Flow 'volume_create_manager' (f61088f7-82b4-4844-8ac8-b33f640a82a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4926648f-26e4-4721-b1c0-48f28c5050aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:08 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4926648f-26e4-4721-b1c0-48f28c5050aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822837724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b667e876-f0b4-4caa-86a7-e14b1d6b5de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7664f122bfe342a5b096b9240bb0c376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:09Z,use_quota=True,user_id='8ca729fb165e413182aba15a9ebb69f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0dbf4b-f4c2-4c67-ab38-9bc58c7be883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0dbf4b-f4c2-4c67-ab38-9bc58c7be883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b190c9-d9f5-4c1c-a7e9-fde727855aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b190c9-d9f5-4c1c-a7e9-fde727855aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b667e876-f0b4-4caa-86a7-e14b1d6b5de6', 'volume_name': 'volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858050df-c0af-4e93-a69c-b9bbe4e37f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858050df-c0af-4e93-a69c-b9bbe4e37f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d929d32-0e29-43f1-ad43-f757fbd070c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:08 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Volume b667e876-f0b4-4caa-86a7-e14b1d6b5de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6', 'volume_size': 1}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822837724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b667e876-f0b4-4caa-86a7-e14b1d6b5de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7664f122bfe342a5b096b9240bb0c376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:09Z,use_quota=True,user_id='8ca729fb165e413182aba15a9ebb69f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Creating volume b667e876-f0b4-4caa-86a7-e14b1d6b5de6 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:08 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa" returned: 0 in 0.433s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:08 devstack sudo[105104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6 1073741824
Jul 19 20:02:08 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:08 devstack sudo[105105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa
Jul 19 20:02:08 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:09 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-quobyte-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa" released by "delete_volume" :: held 0.733s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Created reservations ['16e75763-c5e6-4789-9da3-8bde90213ea7', '210fc46f-ad62-42b1-af2c-54809a5cbfcf', 'c24260af-35a1-469c-8b95-7c04cede3e7d', 'd1aad587-6b97-40db-8313-420d8cc7ce67'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:09 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:09 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:09 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6 1073741824" returned: 0 in 0.453s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:09 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6
Jul 19 20:02:09 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:09 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.262s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:09 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Deleted volume successfully.
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-997b8f3a-9bea-47de-af86-a4ca4384e347 tempest-CreateVolumesFromImageTest-1012129977 None] Lock "cinder-bb309935-4cbc-4d5b-ab9b-5214ba5c30fa-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:09 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6" returned: 0 in 0.266s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d929d32-0e29-43f1-ad43-f757fbd070c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5b69d8-373f-4dd5-aefe-9acf795fcb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:09 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Volume volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6 (b667e876-f0b4-4caa-86a7-e14b1d6b5de6): created successfully
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5b69d8-373f-4dd5-aefe-9acf795fcb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Flow 'volume_create_manager' (f61088f7-82b4-4844-8ac8-b33f640a82a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:09 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d4c5d5d5-aa89-44b1-893e-a8b5279c74f2 tempest-ProjectReaderTests-1417842400 None] Created volume successfully.
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "cinder-b667e876-f0b4-4caa-86a7-e14b1d6b5de6-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Lock "cinder-b667e876-f0b4-4caa-86a7-e14b1d6b5de6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "cinder-quobyte-b667e876-f0b4-4caa-86a7-e14b1d6b5de6" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Lock "cinder-quobyte-b667e876-f0b4-4caa-86a7-e14b1d6b5de6" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dad67d-ea5e-4331-a84d-8dd54bb32dc1]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:10 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6
Jul 19 20:02:10 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:10 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6" returned: 0 in 0.459s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:10 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6
Jul 19 20:02:10 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:10 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b667e876-f0b4-4caa-86a7-e14b1d6b5de6" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Lock "cinder-quobyte-b667e876-f0b4-4caa-86a7-e14b1d6b5de6" released by "delete_volume" :: held 0.784s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Created reservations ['fcf2d459-7117-4216-bb6e-b17bd42e42f2', 'ab1ddefa-cdb2-4ee5-9c8a-9f745061605e', '0f59e197-c089-4524-8e66-0a3aa6af4833', '9bd4e13e-fad8-47d4-a9e8-793eda28a051'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:10 devstack sudo[105131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:10 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:11 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Deleted volume successfully.
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-5adc8adf-6f06-4c87-8fa6-45967cadb593 tempest-ProjectReaderTests-1417842400 None] Lock "cinder-b667e876-f0b4-4caa-86a7-e14b1d6b5de6-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Flow 'volume_create_manager' (9f0d5c36-c06b-4f32-b41e-cb7304113482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f7f0a7-050f-496a-a9ca-00029629fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f7f0a7-050f-496a-a9ca-00029629fc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789285511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04357a9-944b-44a9-9bfa-741071111fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7664f122bfe342a5b096b9240bb0c376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:11Z,use_quota=True,user_id='8ca729fb165e413182aba15a9ebb69f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdb6d09-4a6e-474f-b8da-e20a60bc78a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdb6d09-4a6e-474f-b8da-e20a60bc78a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88168d0-23a4-4d99-9fcf-d7418eda2176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88168d0-23a4-4d99-9fcf-d7418eda2176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04357a9-944b-44a9-9bfa-741071111fcd', 'volume_name': 'volume-b04357a9-944b-44a9-9bfa-741071111fcd', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac24e167-e8a3-426a-bc72-d197e63bf3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac24e167-e8a3-426a-bc72-d197e63bf3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871500f7-2e25-406e-9b2b-231189c36e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:11 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Volume b04357a9-944b-44a9-9bfa-741071111fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04357a9-944b-44a9-9bfa-741071111fcd', 'volume_size': 1}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789285511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04357a9-944b-44a9-9bfa-741071111fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7664f122bfe342a5b096b9240bb0c376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:11Z,use_quota=True,user_id='8ca729fb165e413182aba15a9ebb69f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Creating volume b04357a9-944b-44a9-9bfa-741071111fcd {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:11 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:11 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd 1073741824
Jul 19 20:02:11 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:12 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd 1073741824" returned: 0 in 0.434s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:12 devstack sudo[105140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd
Jul 19 20:02:12 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:12 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd" returned: 0 in 0.251s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871500f7-2e25-406e-9b2b-231189c36e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04357a9-944b-44a9-9bfa-741071111fcd', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cc665b-739a-452e-9382-ea7b7774b4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:12 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Volume volume-b04357a9-944b-44a9-9bfa-741071111fcd (b04357a9-944b-44a9-9bfa-741071111fcd): created successfully
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cc665b-739a-452e-9382-ea7b7774b4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Flow 'volume_create_manager' (9f0d5c36-c06b-4f32-b41e-cb7304113482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:12 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0b4c6742-88ce-44e8-917c-199358473254 tempest-ProjectReaderTests-1417842400 None] Created volume successfully.
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Acquiring lock "cinder-b04357a9-944b-44a9-9bfa-741071111fcd-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Lock "cinder-b04357a9-944b-44a9-9bfa-741071111fcd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Acquiring lock "cinder-quobyte-b04357a9-944b-44a9-9bfa-741071111fcd" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Flow 'volume_create_manager' (ced0a884-7c02-4071-a72e-3fdc805a7be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9ca13b-59eb-473b-9bf7-f8e873838192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Lock "cinder-quobyte-b04357a9-944b-44a9-9bfa-741071111fcd" acquired by "delete_volume" :: waited 0.045s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddf618a-102d-4b1d-a450-1413caf38f10]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9ca13b-59eb-473b-9bf7-f8e873838192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea9c502-7d80-4fb5-af29-60069278908f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28d1ded200943dd8b5c82dc657fadb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:13Z,use_quota=True,user_id='f382c26d40fd4efb99ea1e7baf2074ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc2c99d-4062-48d6-81e8-e3717d6bf833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc2c99d-4062-48d6-81e8-e3717d6bf833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa140e0-4cea-4d87-bae3-775fedb3ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa140e0-4cea-4d87-bae3-775fedb3ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea9c502-7d80-4fb5-af29-60069278908f', 'volume_name': 'volume-1ea9c502-7d80-4fb5-af29-60069278908f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3764a27-135d-44f7-bdcf-2f9e8a8c6c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3764a27-135d-44f7-bdcf-2f9e8a8c6c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1d8787-e5ac-49ad-95a1-3e214cff4dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:12 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Volume 1ea9c502-7d80-4fb5-af29-60069278908f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea9c502-7d80-4fb5-af29-60069278908f', 'volume_size': 1}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea9c502-7d80-4fb5-af29-60069278908f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28d1ded200943dd8b5c82dc657fadb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:13Z,use_quota=True,user_id='f382c26d40fd4efb99ea1e7baf2074ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Creating volume 1ea9c502-7d80-4fb5-af29-60069278908f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:12 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:12 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f 1073741824
Jul 19 20:02:12 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:12 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd
Jul 19 20:02:12 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:13 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd" returned: 0 in 0.375s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:13 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd
Jul 19 20:02:13 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:13 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f 1073741824" returned: 0 in 0.425s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:13 devstack sudo[105156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f
Jul 19 20:02:13 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:13 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b04357a9-944b-44a9-9bfa-741071111fcd" returned: 0 in 0.264s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Lock "cinder-quobyte-b04357a9-944b-44a9-9bfa-741071111fcd" released by "delete_volume" :: held 0.681s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Created reservations ['7a08995a-8420-4f19-8769-dd4dc9c2ec84', '218cb517-8001-4e8c-a69a-7f0e1cc1eacb', 'ac3c34c4-b4ce-4413-baf0-69eeaa854850', '02afe4f1-2e51-4360-8339-4dca40d267c0'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:13 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:13 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:13 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1d8787-e5ac-49ad-95a1-3e214cff4dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea9c502-7d80-4fb5-af29-60069278908f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c830ea98-31bd-489d-ba3e-331e3a145ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:13 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Volume volume-1ea9c502-7d80-4fb5-af29-60069278908f (1ea9c502-7d80-4fb5-af29-60069278908f): created successfully
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c830ea98-31bd-489d-ba3e-331e3a145ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Flow 'volume_create_manager' (ced0a884-7c02-4071-a72e-3fdc805a7be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0489c291-d4ef-45b2-9a99-9803bf8f23c2 tempest-CinderUnicodeTest-836155545 None] Created volume successfully.
Jul 19 20:02:13 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.264s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Deleted volume successfully.
Jul 19 20:02:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aec5f29b-fa32-44b2-bc88-5ecca68011db tempest-ProjectReaderTests-1417842400 None] Lock "cinder-b04357a9-944b-44a9-9bfa-741071111fcd-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Flow 'volume_create_manager' (977878e2-e058-4ec3-b36b-976a8e245212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1da481-b441-4e43-a0b5-14d8ea3cc2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1da481-b441-4e43-a0b5-14d8ea3cc2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1906082931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2063d8cf-8ede-4636-94ee-af9aa76b55ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28d1ded200943dd8b5c82dc657fadb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:15Z,use_quota=True,user_id='f382c26d40fd4efb99ea1e7baf2074ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f561da5-7720-4cf1-9b1a-ce9d8ecefacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f561da5-7720-4cf1-9b1a-ce9d8ecefacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e306e7-22e4-4c3a-9ac2-633a6d7700aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e306e7-22e4-4c3a-9ac2-633a6d7700aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2063d8cf-8ede-4636-94ee-af9aa76b55ee', 'volume_name': 'volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18b39eb-e9c9-4a86-83ea-2886ea005fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18b39eb-e9c9-4a86-83ea-2886ea005fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c993b14-292c-4d26-b86a-1adc20ffa727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:15 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Volume 2063d8cf-8ede-4636-94ee-af9aa76b55ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee', 'volume_size': 1}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1906082931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2063d8cf-8ede-4636-94ee-af9aa76b55ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d28d1ded200943dd8b5c82dc657fadb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:15Z,use_quota=True,user_id='f382c26d40fd4efb99ea1e7baf2074ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Creating volume 2063d8cf-8ede-4636-94ee-af9aa76b55ee {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:15 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:15 devstack sudo[105164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee 1073741824
Jul 19 20:02:15 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:15 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee 1073741824" returned: 0 in 0.438s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:15 devstack sudo[105169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee
Jul 19 20:02:15 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:16 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee" returned: 0 in 0.261s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c993b14-292c-4d26-b86a-1adc20ffa727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24a763b-5d6a-442a-b8e9-d689175e53f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:16 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Volume volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee (2063d8cf-8ede-4636-94ee-af9aa76b55ee): created successfully
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24a763b-5d6a-442a-b8e9-d689175e53f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Flow 'volume_create_manager' (977878e2-e058-4ec3-b36b-976a8e245212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:16 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a640f9b0-42b8-42c3-95d3-2c8aab14b441 tempest-CinderUnicodeTest-836155545 None] Created volume successfully.
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Creating offline snapshot 834cf14f-2309-4f31-b082-203ef8079726 of volume 2063d8cf-8ede-4636-94ee-af9aa76b55ee {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e9d8f2-7063-4852-877e-0cf3b76ba61e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:16 devstack sudo[105172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee
Jul 19 20:02:16 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:16 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee" returned: 0 in 0.381s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:16 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 1G
Jul 19 20:02:16 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:17 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 1G" returned: 0 in 0.472s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:17 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726
Jul 19 20:02:17 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:17 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726" returned: 0 in 0.320s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:17 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 is being set with open permissions: ugo+rw
Jul 19 20:02:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:17 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726
Jul 19 20:02:17 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:17 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:18 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.info
Jul 19 20:02:18 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:18 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.info" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:18 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.info is being set with open permissions: ugo+rw
Jul 19 20:02:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:18 devstack sudo[105194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.info
Jul 19 20:02:18 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:18 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.info" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:18 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ce330328-c361-48f4-9818-a2c6448a398e tempest-CinderUnicodeTest-836155545 None] Create snapshot completed successfully
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "cinder-834cf14f-2309-4f31-b082-203ef8079726-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-834cf14f-2309-4f31-b082-203ef8079726-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "cinder-quobyte-2063d8cf-8ede-4636-94ee-af9aa76b55ee" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-quobyte-2063d8cf-8ede-4636-94ee-af9aa76b55ee" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "cinder-quobyte-834cf14f-2309-4f31-b082-203ef8079726" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-quobyte-834cf14f-2309-4f31-b082-203ef8079726" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Deleting offline snapshot 834cf14f-2309-4f31-b082-203ef8079726 of volume 2063d8cf-8ede-4636-94ee-af9aa76b55ee {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] snapshot_file for this snap is: volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5448c35f-b340-4a89-b179-e9407596407f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:19 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726
Jul 19 20:02:19 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:20 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726" returned: 0 in 0.366s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:02:20 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d282ec9-6f33-45f6-a95d-c4d89e0b55f5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:20 devstack sudo[105202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee
Jul 19 20:02:20 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:20 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee" returned: 0 in 0.411s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:20 devstack sudo[105207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726
Jul 19 20:02:20 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:20 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726" returned: 0 in 0.355s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:20 devstack sudo[105213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726
Jul 19 20:02:20 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:21 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee.834cf14f-2309-4f31-b082-203ef8079726" returned: 0 in 0.278s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-quobyte-834cf14f-2309-4f31-b082-203ef8079726" released by "_delete_snapshot" :: held 1.523s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-quobyte-2063d8cf-8ede-4636-94ee-af9aa76b55ee" released by "delete_snapshot" :: held 1.548s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Created reservations ['60b1979f-e15f-430c-948a-a987dd4b392c', '8a2390bb-a484-4ac5-a261-73ec228b7b25', 'ab9f5406-9a75-4277-b944-8df19534e0bd', 'd951a911-42a4-4e83-b411-3ff54c8c86c1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:21 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Delete snapshot completed successfully.
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8b097c7-eed4-4760-8db8-57f751fdf9c8 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-834cf14f-2309-4f31-b082-203ef8079726-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Acquiring lock "cinder-2063d8cf-8ede-4636-94ee-af9aa76b55ee-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Lock "cinder-2063d8cf-8ede-4636-94ee-af9aa76b55ee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Acquiring lock "cinder-quobyte-2063d8cf-8ede-4636-94ee-af9aa76b55ee" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Lock "cinder-quobyte-2063d8cf-8ede-4636-94ee-af9aa76b55ee" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c57121-2f4b-4ceb-9d3a-96b5e323e337]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:22 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee
Jul 19 20:02:22 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:22 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee" returned: 0 in 0.406s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:22 devstack sudo[105222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee
Jul 19 20:02:22 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:22 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2063d8cf-8ede-4636-94ee-af9aa76b55ee" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Lock "cinder-quobyte-2063d8cf-8ede-4636-94ee-af9aa76b55ee" released by "delete_volume" :: held 0.758s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Created reservations ['34b9a42a-4eb5-44ff-9dcf-1549fdfe107b', '31c798a9-1884-40b5-9899-80ebad887ee5', 'a87c6b00-8d8e-453a-8647-e1123fe5d07c', '12077567-a453-4745-ae84-85a26034f7f2'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:22 devstack sudo[105225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:22 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:23 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "cinder-1ea9c502-7d80-4fb5-af29-60069278908f-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.268s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Deleted volume successfully.
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-1ea9c502-7d80-4fb5-af29-60069278908f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8c514d9b-e5b7-4753-8a1c-29ef713b5fef tempest-CinderUnicodeTest-836155545 None] Lock "cinder-2063d8cf-8ede-4636-94ee-af9aa76b55ee-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "cinder-quobyte-1ea9c502-7d80-4fb5-af29-60069278908f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-quobyte-1ea9c502-7d80-4fb5-af29-60069278908f" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[51259153-3ad2-4277-becd-d414937685fa]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:23 devstack sudo[105228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f
Jul 19 20:02:23 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:23 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f" returned: 0 in 0.493s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:23 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f
Jul 19 20:02:23 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:23 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1ea9c502-7d80-4fb5-af29-60069278908f" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-quobyte-1ea9c502-7d80-4fb5-af29-60069278908f" released by "delete_volume" :: held 0.813s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Created reservations ['ee117306-2056-42e8-be5e-76d57308c78c', '26228552-1d79-48ce-80a1-6f67faeb3db4', '1bef272f-912c-40d1-ad83-51c2d3beb9f0', '895cf3e1-4268-4482-aafd-098d4c43ba53'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:24 devstack sudo[105273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:24 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:24 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.315s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:24 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Deleted volume successfully.
Jul 19 20:02:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-59e5c66e-bb6e-4d22-abc5-2255ece6a613 tempest-CinderUnicodeTest-836155545 None] Lock "cinder-1ea9c502-7d80-4fb5-af29-60069278908f-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:02:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:32 devstack sudo[105283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:32 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=157,cinder:UPDATE=222,cinder:INSERT=56,cinder:DELETE=20 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=241,cinder:SELECT=158,cinder:DELETE=21,cinder:INSERT=53 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Flow 'volume_create_manager' (21921a4e-6976-40b7-b6a5-1ad07b325edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b91140a-46d7-4ffa-a1b7-a8bd77ca2d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:33 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.325s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b91140a-46d7-4ffa-a1b7-a8bd77ca2d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-517591937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2505fef7-9da6-43c8-8889-119f48ec473f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744dd143935c413f8f96dc50eb509309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:33Z,use_quota=True,user_id='4485088c9ad64159b239d0bc13a5bd91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1c4556-97cf-4760-b3a8-1b885f9b8107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1c4556-97cf-4760-b3a8-1b885f9b8107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f9e9ae-8a2a-45d6-90b6-3fda12bca292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f9e9ae-8a2a-45d6-90b6-3fda12bca292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2505fef7-9da6-43c8-8889-119f48ec473f', 'volume_name': 'volume-2505fef7-9da6-43c8-8889-119f48ec473f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f067fc1d-a159-4bec-9259-8cfff3a275bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f067fc1d-a159-4bec-9259-8cfff3a275bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee97782-be81-4149-bbe2-35d482a7478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Volume 2505fef7-9da6-43c8-8889-119f48ec473f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2505fef7-9da6-43c8-8889-119f48ec473f', 'volume_size': 1}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-517591937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2505fef7-9da6-43c8-8889-119f48ec473f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744dd143935c413f8f96dc50eb509309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:33Z,use_quota=True,user_id='4485088c9ad64159b239d0bc13a5bd91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Creating volume 2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:33 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 20:02:33 devstack sudo[105286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f 1073741824
Jul 19 20:02:33 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:33 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f 1073741824" returned: 0 in 0.398s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:33 devstack sudo[105291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f
Jul 19 20:02:33 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:33 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f" returned: 0 in 0.244s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee97782-be81-4149-bbe2-35d482a7478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2505fef7-9da6-43c8-8889-119f48ec473f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b68bfb-3c6a-402d-88a1-30ba6ad663c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Volume volume-2505fef7-9da6-43c8-8889-119f48ec473f (2505fef7-9da6-43c8-8889-119f48ec473f): created successfully
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b68bfb-3c6a-402d-88a1-30ba6ad663c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Flow 'volume_create_manager' (21921a4e-6976-40b7-b6a5-1ad07b325edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7a1bdc7c-81a9-42bf-8b15-435e998370ab tempest-SnapshotDependencyTests-1775243750 None] Created volume successfully.
Jul 19 20:02:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Creating offline snapshot 2c2788d7-abb3-493d-bb03-d4449b14825d of volume 2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:02:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d93f2df-dbbc-4e77-9f0b-c21b897d6ec2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:34 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f
Jul 19 20:02:34 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:34 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f" returned: 0 in 0.353s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:34 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d 1G
Jul 19 20:02:34 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:35 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d 1G" returned: 0 in 0.376s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2505fef7-9da6-43c8-8889-119f48ec473f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:35 devstack sudo[105305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2505fef7-9da6-43c8-8889-119f48ec473f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d
Jul 19 20:02:35 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:35 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2505fef7-9da6-43c8-8889-119f48ec473f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d" returned: 0 in 0.291s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:35 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d is being set with open permissions: ugo+rw
Jul 19 20:02:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:35 devstack sudo[105310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d
Jul 19 20:02:35 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:35 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:35 devstack sudo[105313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.info
Jul 19 20:02:35 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:35 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.info" returned: 0 in 0.246s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:35 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.info is being set with open permissions: ugo+rw
Jul 19 20:02:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:35 devstack sudo[105316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.info
Jul 19 20:02:35 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:36 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.info" returned: 0 in 0.238s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1f414d50-4194-4972-bae0-86ad97b838db tempest-SnapshotDependencyTests-1775243750 None] Create snapshot completed successfully
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Flow 'volume_create_manager' (249abc07-cab6-4aee-8bd3-64ea3c25e661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bd87e4-23be-4a91-859e-765639459529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bd87e4-23be-4a91-859e-765639459529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1955e9-2f50-4a98-8c17-9183d78056f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744dd143935c413f8f96dc50eb509309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c2788d7-abb3-493d-bb03-d4449b14825d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:02:37Z,use_quota=True,user_id='4485088c9ad64159b239d0bc13a5bd91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc236d05-6d7e-4b14-825b-fc85d2936947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc236d05-6d7e-4b14-825b-fc85d2936947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba73d67a-ef14-49d3-a333-78d97271013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba73d67a-ef14-49d3-a333-78d97271013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f1955e9-2f50-4a98-8c17-9183d78056f4', 'volume_name': 'volume-4f1955e9-2f50-4a98-8c17-9183d78056f4', 'volume_size': 1, 'snapshot_id': '2c2788d7-abb3-493d-bb03-d4449b14825d'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ae6273-925c-4157-bcd2-111fe7fac7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ae6273-925c-4157-bcd2-111fe7fac7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d5762a-8d36-4d74-b35d-5fed335cc23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Volume 4f1955e9-2f50-4a98-8c17-9183d78056f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f1955e9-2f50-4a98-8c17-9183d78056f4', 'volume_size': 1, 'snapshot_id': '2c2788d7-abb3-493d-bb03-d4449b14825d'}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-quobyte-2c2788d7-abb3-493d-bb03-d4449b14825d-4f1955e9-2f50-4a98-8c17-9183d78056f4" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-2c2788d7-abb3-493d-bb03-d4449b14825d-4f1955e9-2f50-4a98-8c17-9183d78056f4" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Creating volume 4f1955e9-2f50-4a98-8c17-9183d78056f4 from snapshot 2c2788d7-abb3-493d-bb03-d4449b14825d {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-quobyte-4f1955e9-2f50-4a98-8c17-9183d78056f4" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-4f1955e9-2f50-4a98-8c17-9183d78056f4" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] snapshot: 2c2788d7-abb3-493d-bb03-d4449b14825d, volume: 4f1955e9-2f50-4a98-8c17-9183d78056f4,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1df712a-7976-4858-9d20-ae311d852ab0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:37 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d
Jul 19 20:02:37 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:37 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d" returned: 0 in 0.364s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2505fef7-9da6-43c8-8889-119f48ec473f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9571400c-2135-4fd7-be2d-c3fffe90e7b0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:37 devstack sudo[105324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f
Jul 19 20:02:37 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:37 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4 not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 20:02:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:37 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4
Jul 19 20:02:37 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:41 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4" returned: 0 in 3.962s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:41 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d31766-ba4c-4ac1-8171-7c9c2bf0f85b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:41 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f
Jul 19 20:02:41 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:42 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f" returned: 0 in 0.544s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 20:02:42 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Converted 1024.00 MB image at 258.36 MB/s
Jul 19 20:02:42 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4 is being set with open permissions: ugo+rw
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:42 devstack sudo[105348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4
Jul 19 20:02:42 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:42 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4" returned: 0 in 0.235s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-4f1955e9-2f50-4a98-8c17-9183d78056f4" released by "_copy_volume_from_snapshot" :: held 5.530s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-2c2788d7-abb3-493d-bb03-d4449b14825d-4f1955e9-2f50-4a98-8c17-9183d78056f4" released by "_create_volume_from_snapshot" :: held 5.557s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.571s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d5762a-8d36-4d74-b35d-5fed335cc23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1955e9-2f50-4a98-8c17-9183d78056f4', 'volume_size': 1, 'snapshot_id': '2c2788d7-abb3-493d-bb03-d4449b14825d'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3892464f-e326-4d0f-bd5a-b65df9f922e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:02:42 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Volume volume-4f1955e9-2f50-4a98-8c17-9183d78056f4 (4f1955e9-2f50-4a98-8c17-9183d78056f4): created successfully
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3892464f-e326-4d0f-bd5a-b65df9f922e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:02:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Flow 'volume_create_manager' (249abc07-cab6-4aee-8bd3-64ea3c25e661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:02:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-912c048d-ace6-445e-a539-b134e6ef919b tempest-SnapshotDependencyTests-1775243750 None] Created volume successfully.
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-2c2788d7-abb3-493d-bb03-d4449b14825d-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-2c2788d7-abb3-493d-bb03-d4449b14825d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-quobyte-2505fef7-9da6-43c8-8889-119f48ec473f" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-2505fef7-9da6-43c8-8889-119f48ec473f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-quobyte-2c2788d7-abb3-493d-bb03-d4449b14825d" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-2c2788d7-abb3-493d-bb03-d4449b14825d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Deleting offline snapshot 2c2788d7-abb3-493d-bb03-d4449b14825d of volume 2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] snapshot_file for this snap is: volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb399e33-03ff-47c4-9c73-80700fcf3a47]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:43 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d
Jul 19 20:02:43 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:43 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d" returned: 0 in 0.346s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2505fef7-9da6-43c8-8889-119f48ec473f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c0adb9-a385-4833-8ae3-34dd26b678e5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:44 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f
Jul 19 20:02:44 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:44 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f" returned: 0 in 0.346s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:44 devstack sudo[105364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d
Jul 19 20:02:44 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:44 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d" returned: 0 in 0.326s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:44 devstack sudo[105370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d
Jul 19 20:02:44 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:44 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f.2c2788d7-abb3-493d-bb03-d4449b14825d" returned: 0 in 0.239s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-2c2788d7-abb3-493d-bb03-d4449b14825d" released by "_delete_snapshot" :: held 1.349s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-2505fef7-9da6-43c8-8889-119f48ec473f" released by "delete_snapshot" :: held 1.369s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:44 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Created reservations ['69e2638c-d856-4a96-9eb9-8512ec1ecba9', '1797ca71-e4b4-42ee-8981-ddc5eba1af7f', '1c351337-7fce-45fe-848d-177a5f514cd2', '0d5bd5cb-73a6-4107-89ce-d2c6c8b6f9d7'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:45 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Delete snapshot completed successfully.
Jul 19 20:02:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8f54a9f6-06af-4eaa-abc8-5a9b57952f99 tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-2c2788d7-abb3-493d-bb03-d4449b14825d-delete_snapshot" released by "delete_snapshot" :: held 1.491s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-2505fef7-9da6-43c8-8889-119f48ec473f-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-2505fef7-9da6-43c8-8889-119f48ec473f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-quobyte-2505fef7-9da6-43c8-8889-119f48ec473f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-2505fef7-9da6-43c8-8889-119f48ec473f" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b3b5bc-43d6-4455-9c7f-ef728881611e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:45 devstack sudo[105373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f
Jul 19 20:02:45 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:46 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f" returned: 0 in 0.342s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:46 devstack sudo[105378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f
Jul 19 20:02:46 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:46 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2505fef7-9da6-43c8-8889-119f48ec473f" returned: 0 in 0.245s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-2505fef7-9da6-43c8-8889-119f48ec473f" released by "delete_volume" :: held 0.641s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Created reservations ['682cf969-c8ee-401e-b582-f59fccae1086', 'bb60dff2-3961-435c-adf5-7afc4dd68519', 'f890c062-3820-4764-9cf9-6e5fcf4cf463', '1c701299-4f4d-4150-9020-3dd0896ac2c9'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:46 devstack sudo[105381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:46 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:46 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.237s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Deleted volume successfully.
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74ad0f08-9da2-46e9-95c9-33c93132869a tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-2505fef7-9da6-43c8-8889-119f48ec473f-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-4f1955e9-2f50-4a98-8c17-9183d78056f4-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-4f1955e9-2f50-4a98-8c17-9183d78056f4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "cinder-quobyte-4f1955e9-2f50-4a98-8c17-9183d78056f4" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-4f1955e9-2f50-4a98-8c17-9183d78056f4" acquired by "delete_volume" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceccfb14-a043-4a87-8a42-d89b30819ffe]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:02:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:47 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4
Jul 19 20:02:47 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:47 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:47 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4
Jul 19 20:02:47 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:47 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4f1955e9-2f50-4a98-8c17-9183d78056f4" returned: 0 in 0.246s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-quobyte-4f1955e9-2f50-4a98-8c17-9183d78056f4" released by "delete_volume" :: held 0.629s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Created reservations ['168a5350-5519-4c36-a7a0-e0d05361bc1e', '8d2b3d7f-9f2f-4261-aced-4d6c54d05181', 'f034f417-9474-411b-b1e4-2d2c09e3406d', 'e1bb3117-bcfa-4179-bb68-9a941dc49720'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:02:47 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:02:47 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:02:47 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.245s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:02:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Deleted volume successfully.
Jul 19 20:02:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-fe8589ce-f390-4719-8f07-7253ff91abea tempest-SnapshotDependencyTests-1775243750 None] Lock "cinder-4f1955e9-2f50-4a98-8c17-9183d78056f4-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:02:57 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:02:57 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=22,cinder:UPDATE=26,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Flow 'volume_create_manager' (6573dba7-106b-4af4-9ab1-812125980c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afc27bd-a534-4b9c-b28d-579d7be19e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afc27bd-a534-4b9c-b28d-579d7be19e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-803605073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4808aed3-3362-4098-bb47-674647ffdab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78081234ea94266bc01cf79c6151951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:06Z,use_quota=True,user_id='aa7736ccb080417cba3ecdf78ccb2451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6d8e27-d6d6-4a03-bce8-b8cf69808c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6d8e27-d6d6-4a03-bce8-b8cf69808c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37642111-b77e-4e48-b152-f746bff161fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37642111-b77e-4e48-b152-f746bff161fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4808aed3-3362-4098-bb47-674647ffdab6', 'volume_name': 'volume-4808aed3-3362-4098-bb47-674647ffdab6', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1c57fe-ccd3-4084-8168-93f565224c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1c57fe-ccd3-4084-8168-93f565224c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6224379d-a642-44ec-9772-3abe0970148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Volume 4808aed3-3362-4098-bb47-674647ffdab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4808aed3-3362-4098-bb47-674647ffdab6', 'volume_size': 1}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-803605073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4808aed3-3362-4098-bb47-674647ffdab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78081234ea94266bc01cf79c6151951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:06Z,use_quota=True,user_id='aa7736ccb080417cba3ecdf78ccb2451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Creating volume 4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:06 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:06 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 1073741824
Jul 19 20:03:06 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (5d82dc59-aff8-4c21-972e-00dec80904a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18de6c8a-57cd-4516-80d7-68ac64174761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18de6c8a-57cd-4516-80d7-68ac64174761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-781131634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eea2762-0502-4de4-b628-a0531297e47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:06Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927cc5ab-7932-42ed-88e3-13079c6ee2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927cc5ab-7932-42ed-88e3-13079c6ee2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695c8f03-cc0d-44fe-9b03-3b853f2dcfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695c8f03-cc0d-44fe-9b03-3b853f2dcfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eea2762-0502-4de4-b628-a0531297e47c', 'volume_name': 'volume-2eea2762-0502-4de4-b628-a0531297e47c', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa13ba1-5182-4d29-bd9b-1138bf1e5d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa13ba1-5182-4d29-bd9b-1138bf1e5d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf80c82-a398-4729-b681-cd3e4b160154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Volume 2eea2762-0502-4de4-b628-a0531297e47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eea2762-0502-4de4-b628-a0531297e47c', 'volume_size': 1}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (603a0498-97dd-4b8c-8084-1a30919097ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd8b73c-13ed-4c19-9a1a-dfd7ea001cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd8b73c-13ed-4c19-9a1a-dfd7ea001cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1102299316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b54fd2-ab1c-44f0-a4ba-6e143a188c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:07Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ea0654-32df-40bb-8cf5-edde6b4b1a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ea0654-32df-40bb-8cf5-edde6b4b1a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afe11f9-f01c-45fb-adec-5d1602a5a8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afe11f9-f01c-45fb-adec-5d1602a5a8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b54fd2-ab1c-44f0-a4ba-6e143a188c00', 'volume_name': 'volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b0e1f0-e6ab-4971-9ced-33664d415d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b0e1f0-e6ab-4971-9ced-33664d415d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85c3f3c-15a8-4442-811e-7103499e251b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:06 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Volume 32b54fd2-ab1c-44f0-a4ba-6e143a188c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00', 'volume_size': 1}
Jul 19 20:03:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:07 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 1073741824" returned: 0 in 0.684s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (83e6cd03-07a7-4989-a244-36a236e71a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbc15f9-d3d5-4381-9c1e-8408f57de146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbc15f9-d3d5-4381-9c1e-8408f57de146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673426443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ee6d22-39c1-4825-8c73-0cef02492415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:07Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96b603e-9270-4854-bc37-3927e324c91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96b603e-9270-4854-bc37-3927e324c91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e51259-3094-40fb-8b9f-5d30bd48a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e51259-3094-40fb-8b9f-5d30bd48a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ee6d22-39c1-4825-8c73-0cef02492415', 'volume_name': 'volume-69ee6d22-39c1-4825-8c73-0cef02492415', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b45c5b4-8502-4710-ba2b-4571e24bae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b45c5b4-8502-4710-ba2b-4571e24bae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bffa8e5-d44b-4233-b8e2-99785973cecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume 69ee6d22-39c1-4825-8c73-0cef02492415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ee6d22-39c1-4825-8c73-0cef02492415', 'volume_size': 1}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:07 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6
Jul 19 20:03:07 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (e8aec3ce-3def-4330-934a-57d61604aebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9578a7b-aa44-4694-b062-c912e64f3603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9578a7b-aa44-4694-b062-c912e64f3603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2002468256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdabf0a-660e-48c0-80a6-f1dc4022b9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:07Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6799b71b-672c-45e6-9f07-448e49264da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6799b71b-672c-45e6-9f07-448e49264da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4d41bc-f448-474a-afb3-5a321af92e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4d41bc-f448-474a-afb3-5a321af92e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebdabf0a-660e-48c0-80a6-f1dc4022b9da', 'volume_name': 'volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1777bd-b254-4b02-a670-32ab3f24adee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1777bd-b254-4b02-a670-32ab3f24adee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448f5d9f-f147-4e04-a485-7f65cd310577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Volume ebdabf0a-660e-48c0-80a6-f1dc4022b9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da', 'volume_size': 1}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (ffa9a624-ae0e-4e2f-a567-07b8d466d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc3f08c-bb63-4b0a-abf1-79a847f6e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc3f08c-bb63-4b0a-abf1-79a847f6e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-945453244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e63614-4fa8-4c8a-88f5-22e7667db338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:07Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fab4138-8edb-4507-958b-04892a07b170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fab4138-8edb-4507-958b-04892a07b170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09de076-3644-4650-9820-5b06a0607790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09de076-3644-4650-9820-5b06a0607790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e63614-4fa8-4c8a-88f5-22e7667db338', 'volume_name': 'volume-70e63614-4fa8-4c8a-88f5-22e7667db338', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5cbd35-d1a0-4ea9-ae2b-a89a5c7f25f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5cbd35-d1a0-4ea9-ae2b-a89a5c7f25f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af57f86b-6cce-45b2-880c-e538d221c12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Volume 70e63614-4fa8-4c8a-88f5-22e7667db338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e63614-4fa8-4c8a-88f5-22e7667db338', 'volume_size': 1}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:07 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6" returned: 0 in 0.322s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-781131634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eea2762-0502-4de4-b628-a0531297e47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:06Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Creating volume 2eea2762-0502-4de4-b628-a0531297e47c {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:07 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:07 devstack sudo[105452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c 1073741824
Jul 19 20:03:07 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6224379d-a642-44ec-9772-3abe0970148d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4808aed3-3362-4098-bb47-674647ffdab6', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12768c-28d8-4d6a-b400-7302fd0d2ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Volume volume-4808aed3-3362-4098-bb47-674647ffdab6 (4808aed3-3362-4098-bb47-674647ffdab6): created successfully
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12768c-28d8-4d6a-b400-7302fd0d2ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Flow 'volume_create_manager' (6573dba7-106b-4af4-9ab1-812125980c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:07 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-08f0f494-2572-4d0d-b4ce-f5cc90c0a9f4 tempest-VolumeDependencyTests-2139354414 None] Created volume successfully.
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (282d4dc8-dcc0-49a1-9368-908f5664467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ee99cb-e3cd-4a70-aeb8-bb7555afaa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ee99cb-e3cd-4a70-aeb8-bb7555afaa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545876158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178965e9-e90b-48c0-94f0-7354d43eef53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:08Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe400439-f9de-45f2-9421-8dae3e9a4fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe400439-f9de-45f2-9421-8dae3e9a4fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e78456-da02-4f40-9581-e7d269094658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e78456-da02-4f40-9581-e7d269094658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178965e9-e90b-48c0-94f0-7354d43eef53', 'volume_name': 'volume-178965e9-e90b-48c0-94f0-7354d43eef53', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4baea08-8341-410a-b8d8-b620eabc57ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4baea08-8341-410a-b8d8-b620eabc57ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5695c61c-23ee-421d-8645-5a23e077fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:08 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Volume 178965e9-e90b-48c0-94f0-7354d43eef53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178965e9-e90b-48c0-94f0-7354d43eef53', 'volume_size': 1}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:08 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c 1073741824" returned: 0 in 0.571s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:08 devstack sudo[105457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c
Jul 19 20:03:08 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:08 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c" returned: 0 in 0.268s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.779s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1102299316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b54fd2-ab1c-44f0-a4ba-6e143a188c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:07Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Creating volume 32b54fd2-ab1c-44f0-a4ba-6e143a188c00 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:08 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:08 devstack sudo[105460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00 1073741824
Jul 19 20:03:08 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf80c82-a398-4729-b681-cd3e4b160154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eea2762-0502-4de4-b628-a0531297e47c', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4416f6bb-cc3a-4d78-ab13-866f253deb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:08 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Volume volume-2eea2762-0502-4de4-b628-a0531297e47c (2eea2762-0502-4de4-b628-a0531297e47c): created successfully
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4416f6bb-cc3a-4d78-ab13-866f253deb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (5d82dc59-aff8-4c21-972e-00dec80904a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d38e7612-f83b-41ad-8a20-d3785986f664 tempest-CreateVolumesFromImageTest-2125561430 None] Created volume successfully.
Jul 19 20:03:09 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00 1073741824" returned: 0 in 0.461s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:09 devstack sudo[105466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00
Jul 19 20:03:09 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:09 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00" returned: 0 in 0.256s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.053s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673426443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ee6d22-39c1-4825-8c73-0cef02492415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:07Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Creating volume 69ee6d22-39c1-4825-8c73-0cef02492415 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:09 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85c3f3c-15a8-4442-811e-7103499e251b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:09 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415 1073741824
Jul 19 20:03:09 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f20574d-0e10-4e94-a407-363e819e7f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:09 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Volume volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00 (32b54fd2-ab1c-44f0-a4ba-6e143a188c00): created successfully
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f20574d-0e10-4e94-a407-363e819e7f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (603a0498-97dd-4b8c-8084-1a30919097ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:09 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b776361e-727b-47d4-a75f-3a6e2e75577a tempest-CreateVolumesFromImageTest-2125561430 None] Created volume successfully.
Jul 19 20:03:09 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415 1073741824" returned: 0 in 0.451s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:09 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415
Jul 19 20:03:09 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:10 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415" returned: 0 in 0.246s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.623s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2002468256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdabf0a-660e-48c0-80a6-f1dc4022b9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:07Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Creating volume ebdabf0a-660e-48c0-80a6-f1dc4022b9da {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:10 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bffa8e5-d44b-4233-b8e2-99785973cecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ee6d22-39c1-4825-8c73-0cef02492415', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:10 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da 1073741824
Jul 19 20:03:10 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54edb3ff-0850-4363-97f5-ee4026d56998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:10 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume volume-69ee6d22-39c1-4825-8c73-0cef02492415 (69ee6d22-39c1-4825-8c73-0cef02492415): created successfully
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54edb3ff-0850-4363-97f5-ee4026d56998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (83e6cd03-07a7-4989-a244-36a236e71a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-162a2359-f52c-41cb-ba69-e667ee7cf254 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created volume successfully.
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Flow 'volume_create_manager' (bf06257a-bd4d-4e45-a5c2-9cc553a3f61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b384f06-4498-466a-9734-3ef6b290dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b384f06-4498-466a-9734-3ef6b290dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efda6ce9-8a40-4976-aa16-8744b581c1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b9ffc010fe43c59a7a51112cb09ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:10Z,use_quota=True,user_id='9d7675a27d0d4bc19bce7297516f8a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c35801ca-34fe-48da-bc16-db81a564f63f),volume_type_id=c35801ca-34fe-48da-bc16-db81a564f63f)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f19171-7208-4c98-a84c-0c037630978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f19171-7208-4c98-a84c-0c037630978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c8f099-e4c8-414c-b741-0124ae3f3bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 20:03:10 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da 1073741824" returned: 0 in 0.434s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:10 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da
Jul 19 20:03:10 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c8f099-e4c8-414c-b741-0124ae3f3bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efda6ce9-8a40-4976-aa16-8744b581c1c2', 'volume_name': 'volume-efda6ce9-8a40-4976-aa16-8744b581c1c2', 'volume_size': 1, 'image_id': '9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a34e3def3aa5804bd37c5b93be3ee70', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2b9ffc010fe43c59a7a51112cb09ee6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ccd19d0432b69b0e032f25e27ca47c0c279d00e1bb76514d180ca9ca731a8c956574ccc54a095d927d52d495500a1353a0455248f7c795671edc6a7eec21b6d', 'id': '9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'created_at': datetime.datetime(2026, 7, 19, 18, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 18, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ca4fdd0>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958fbf80-b001-4d80-9e54-4d5cbb33fc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958fbf80-b001-4d80-9e54-4d5cbb33fc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab089c44-a1ef-4643-b075-1e15aaafb933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:10 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Volume efda6ce9-8a40-4976-aa16-8744b581c1c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efda6ce9-8a40-4976-aa16-8744b581c1c2', 'volume_size': 1, 'image_id': '9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a34e3def3aa5804bd37c5b93be3ee70', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2b9ffc010fe43c59a7a51112cb09ee6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ccd19d0432b69b0e032f25e27ca47c0c279d00e1bb76514d180ca9ca731a8c956574ccc54a095d927d52d495500a1353a0455248f7c795671edc6a7eec21b6d', 'id': '9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'created_at': datetime.datetime(2026, 7, 19, 18, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 18, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ca4fdd0>}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Trying to clone efda6ce9-8a40-4976-aa16-8744b581c1c2 from image 9e594bdb-51a6-42ef-ba2e-adbac98c2a96 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 20:03:10 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Image download 0.00 MB at 0.00 MB/s
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f6f589-5399-499e-8d8a-f0aeb6e223e9]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:10 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da" returned: 0 in 0.261s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.242s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-945453244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e63614-4fa8-4c8a-88f5-22e7667db338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:07Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Creating volume 70e63614-4fa8-4c8a-88f5-22e7667db338 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:10 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448f5d9f-f147-4e04-a485-7f65cd310577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8237c0c2-c5f8-4a43-8318-319cc70398e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:10 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338 1073741824
Jul 19 20:03:10 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:10 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Volume volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da (ebdabf0a-660e-48c0-80a6-f1dc4022b9da): created successfully
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8237c0c2-c5f8-4a43-8318-319cc70398e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:10 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (e8aec3ce-3def-4330-934a-57d61604aebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a89efd7e-c466-4b10-8517-12e0f1a1437e tempest-CreateVolumesFromImageTest-2125561430 None] Created volume successfully.
Jul 19 20:03:10 devstack sudo[105487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD
Jul 19 20:03:10 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:11 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:11 devstack sudo[105496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD
Jul 19 20:03:11 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:11 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338 1073741824" returned: 0 in 0.576s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:11 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338
Jul 19 20:03:11 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:11 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Temporary image 9e594bdb-51a6-42ef-ba2e-adbac98c2a96 is fetched for user 9d7675a27d0d4bc19bce7297516f8a32. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bc9c24-dd6e-427d-ab60-e17b57c042b9]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:11 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338" returned: 0 in 0.260s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.776s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545876158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178965e9-e90b-48c0-94f0-7354d43eef53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c346afb6747849619835999c8321c978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:08Z,use_quota=True,user_id='5079c48af26f4c7ca70b070023fe869d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Creating volume 178965e9-e90b-48c0-94f0-7354d43eef53 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:11 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:11 devstack sudo[105505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD
Jul 19 20:03:11 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af57f86b-6cce-45b2-880c-e538d221c12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e63614-4fa8-4c8a-88f5-22e7667db338', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:11 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53 1073741824
Jul 19 20:03:11 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1338b2de-e16a-435b-9a54-da0daac6a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:11 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Volume volume-70e63614-4fa8-4c8a-88f5-22e7667db338 (70e63614-4fa8-4c8a-88f5-22e7667db338): created successfully
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1338b2de-e16a-435b-9a54-da0daac6a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:11 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (ffa9a624-ae0e-4e2f-a567-07b8d466d0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1d1c4f2a-c512-43ca-9b3f-044151679c13 tempest-CreateVolumesFromImageTest-2125561430 None] Created volume successfully.
Jul 19 20:03:12 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:12 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD
Jul 19 20:03:12 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:12 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53 1073741824" returned: 0 in 0.410s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:12 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53
Jul 19 20:03:12 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:12 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:12 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.179s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5695c61c-23ee-421d-8645-5a23e077fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178965e9-e90b-48c0-94f0-7354d43eef53', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404c0f5b-3d41-43b7-abba-86b6f09c2f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Creating offline snapshot c1bddd20-d140-4052-ad86-7d3b01b05f84 of volume 4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:03:12 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Volume volume-178965e9-e90b-48c0-94f0-7354d43eef53 (178965e9-e90b-48c0-94f0-7354d43eef53): created successfully
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404c0f5b-3d41-43b7-abba-86b6f09c2f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Flow 'volume_create_manager' (282d4dc8-dcc0-49a1-9368-908f5664467a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06ab603-745c-42e8-86da-ba4efdf22d66]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:12 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e5af616a-8c63-437c-b98e-5e7c3d1a2c78 tempest-CreateVolumesFromImageTest-2125561430 None] Created volume successfully.
Jul 19 20:03:12 devstack sudo[105525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6
Jul 19 20:03:12 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:12 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6" returned: 0 in 0.353s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:13 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 1G
Jul 19 20:03:13 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:13 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 1G" returned: 0 in 0.385s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4808aed3-3362-4098-bb47-674647ffdab6 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:13 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4808aed3-3362-4098-bb47-674647ffdab6 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84
Jul 19 20:03:13 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:13 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4808aed3-3362-4098-bb47-674647ffdab6 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:13 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 is being set with open permissions: ugo+rw
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:13 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84
Jul 19 20:03:13 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-178965e9-e90b-48c0-94f0-7354d43eef53-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-178965e9-e90b-48c0-94f0-7354d43eef53-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-quobyte-178965e9-e90b-48c0-94f0-7354d43eef53" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-178965e9-e90b-48c0-94f0-7354d43eef53" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[795f06e8-36d2-4b1a-96aa-49093ba396e9]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:13 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84" returned: 0 in 0.258s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:13 devstack sudo[105545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.info
Jul 19 20:03:13 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:13 devstack sudo[105543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53
Jul 19 20:03:13 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:14 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.info" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:14 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.info is being set with open permissions: ugo+rw
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:14 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.info
Jul 19 20:03:14 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:14 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53" returned: 0 in 0.361s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:14 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53
Jul 19 20:03:14 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:14 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.info" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Creating offline snapshot e0ea95e5-d64c-4e60-b665-5da6eb1fd342 of volume 69ee6d22-39c1-4825-8c73-0cef02492415 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:03:14 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-178965e9-e90b-48c0-94f0-7354d43eef53" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:14 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9641ecf5-eea9-40ec-893f-7313193a73af tempest-VolumeDependencyTests-2139354414 None] Create snapshot completed successfully
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5664f34-edcd-466b-98b7-0b8a6bf91928]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-178965e9-e90b-48c0-94f0-7354d43eef53" released by "delete_volume" :: held 0.673s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Created reservations ['a741d82c-1a6b-4a28-97b9-ccb38697df3d', 'd5f58ba8-4170-448f-9f5a-cb0f626723ff', '3c189166-f525-4f55-9cf5-5d0c14d608b2', '342c7cf4-7d38-4da4-b412-f3deeafd243d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:14 devstack sudo[105558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415
Jul 19 20:03:14 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:14 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:14 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:14 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415" returned: 0 in 0.431s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:14 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.290s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:14 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:14 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Deleted volume successfully.
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-70e63614-4fa8-4c8a-88f5-22e7667db338-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:15 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 1G
Jul 19 20:03:15 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a79d0f7b-4ec8-4d78-b92f-61bcac529133 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-178965e9-e90b-48c0-94f0-7354d43eef53-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-70e63614-4fa8-4c8a-88f5-22e7667db338-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-quobyte-70e63614-4fa8-4c8a-88f5-22e7667db338" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-70e63614-4fa8-4c8a-88f5-22e7667db338" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6a8630-260e-4500-a5ac-5f76b0842a79]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:15 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338
Jul 19 20:03:15 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Flow 'volume_create_manager' (ee959df2-2b8b-4a4d-8aa0-0f8f0afdd8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00eb262-070e-4d18-b246-cfc8924f5e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00eb262-070e-4d18-b246-cfc8924f5e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-68730675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1a52cf-cabb-40ca-a272-5f3add2e5bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78081234ea94266bc01cf79c6151951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1bddd20-d140-4052-ad86-7d3b01b05f84,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:15Z,use_quota=True,user_id='aa7736ccb080417cba3ecdf78ccb2451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14973147-5f2c-49be-b637-efc65c401494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14973147-5f2c-49be-b637-efc65c401494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfaf2ff-c2f5-4ac8-9a83-80a481c39a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfaf2ff-c2f5-4ac8-9a83-80a481c39a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f1a52cf-cabb-40ca-a272-5f3add2e5bcb', 'volume_name': 'volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb', 'volume_size': 1, 'snapshot_id': 'c1bddd20-d140-4052-ad86-7d3b01b05f84'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cb8ed1-853d-44cf-a257-3c8572123dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cb8ed1-853d-44cf-a257-3c8572123dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e1002d-06c8-4a36-9a45-1302453e1df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:15 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Volume 0f1a52cf-cabb-40ca-a272-5f3add2e5bcb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb', 'volume_size': 1, 'snapshot_id': 'c1bddd20-d140-4052-ad86-7d3b01b05f84'}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:15 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 1G" returned: 0 in 0.501s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ee6d22-39c1-4825-8c73-0cef02492415 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:15 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ee6d22-39c1-4825-8c73-0cef02492415 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342
Jul 19 20:03:15 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:15 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338" returned: 0 in 0.395s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:15 devstack sudo[105578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338
Jul 19 20:03:15 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:15 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69ee6d22-39c1-4825-8c73-0cef02492415 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342" returned: 0 in 0.312s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:15 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 is being set with open permissions: ugo+rw
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:15 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342
Jul 19 20:03:15 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:15 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-70e63614-4fa8-4c8a-88f5-22e7667db338" returned: 0 in 0.260s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-70e63614-4fa8-4c8a-88f5-22e7667db338" released by "delete_volume" :: held 0.703s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Created reservations ['155be15e-68ca-4b17-8e09-2fb2d4a8a6aa', '86a5611f-b55f-4897-a36b-a9d79e76cc7b', '83798c32-1d9b-4f67-982e-006f1bbc89b8', 'f9206d93-47d8-4e3f-9581-daac40e4a1b1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:15 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:15 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:16 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:16 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.info
Jul 19 20:03:16 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:16 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.256s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:16 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Deleted volume successfully.
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-98696810-d3ff-4b4b-8c80-34d8042d16f8 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-70e63614-4fa8-4c8a-88f5-22e7667db338-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-ebdabf0a-660e-48c0-80a6-f1dc4022b9da-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-ebdabf0a-660e-48c0-80a6-f1dc4022b9da-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-quobyte-ebdabf0a-660e-48c0-80a6-f1dc4022b9da" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-ebdabf0a-660e-48c0-80a6-f1dc4022b9da" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[782685e1-2b05-43b7-a9ab-de6cee8d4432]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:16 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.info" returned: 0 in 0.307s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:16 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.info is being set with open permissions: ugo+rw
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:16 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.info
Jul 19 20:03:16 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:16 devstack sudo[105593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da
Jul 19 20:03:16 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:16 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.info" returned: 0 in 0.251s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.229s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efda6ce9-8a40-4976-aa16-8744b581c1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b9ffc010fe43c59a7a51112cb09ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:10Z,use_quota=True,user_id='9d7675a27d0d4bc19bce7297516f8a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c35801ca-34fe-48da-bc16-db81a564f63f),volume_type_id=c35801ca-34fe-48da-bc16-db81a564f63f)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Creating volume efda6ce9-8a40-4976-aa16-8744b581c1c2 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:16 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:16 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 1073741824
Jul 19 20:03:16 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:16 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-74784acb-87ca-430f-b4b9-42f7787a687c tempest-CreateVolumesFromSnapshotTest-226694094 None] Create snapshot completed successfully
Jul 19 20:03:16 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da" returned: 0 in 0.383s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:16 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da
Jul 19 20:03:16 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:16 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ebdabf0a-660e-48c0-80a6-f1dc4022b9da" returned: 0 in 0.261s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-ebdabf0a-660e-48c0-80a6-f1dc4022b9da" released by "delete_volume" :: held 0.689s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Created reservations ['9ba179c8-5ba7-41a0-b541-d87850b04b82', 'd234f1ae-b5db-4fe4-81a7-5764462f8d7e', '18747879-b592-40fb-bf3a-3c0820def656', '020a7f07-f6c0-464e-8a09-0d0c8daf7fde'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:17 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 1073741824" returned: 0 in 0.433s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:17 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2
Jul 19 20:03:17 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:17 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:17 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:17 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:17 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.004s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-quobyte-c1bddd20-d140-4052-ad86-7d3b01b05f84-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-32b54fd2-ab1c-44f0-a4ba-6e143a188c00-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.275s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Deleted volume successfully.
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-32b54fd2-ab1c-44f0-a4ba-6e143a188c00-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-c1bddd20-d140-4052-ad86-7d3b01b05f84-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Creating volume 0f1a52cf-cabb-40ca-a272-5f3add2e5bcb from snapshot c1bddd20-d140-4052-ad86-7d3b01b05f84 {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-quobyte-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f2a36a24-9022-48fe-b04f-dde35edbbabe tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-ebdabf0a-660e-48c0-80a6-f1dc4022b9da-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Attempting download of 9e594bdb-51a6-42ef-ba2e-adbac98c2a96 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'metadata': {}}])) to volume efda6ce9-8a40-4976-aa16-8744b581c1c2. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] snapshot: c1bddd20-d140-4052-ad86-7d3b01b05f84, volume: 0f1a52cf-cabb-40ca-a272-5f3add2e5bcb,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-quobyte-32b54fd2-ab1c-44f0-a4ba-6e143a188c00" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[98988232-5a07-485a-8d57-57dad88b37ea]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[77385600-38cd-4569-ad9f-69e3ce1509d5]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_679opuxl {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-32b54fd2-ab1c-44f0-a4ba-6e143a188c00" acquired by "delete_volume" :: waited 0.043s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6fdaba-fcab-4320-a45b-401be60eafa8]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:17 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84
Jul 19 20:03:17 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:17 devstack sudo[105617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_679opuxl
Jul 19 20:03:17 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:17 devstack sudo[105618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00
Jul 19 20:03:17 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:17 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_679opuxl" returned: 0 in 0.353s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_679opuxl {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:18 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84" returned: 0 in 0.469s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4808aed3-3362-4098-bb47-674647ffdab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[02790062-1cb1-4aa6-b1a2-fdb3adf27273]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:18 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00" returned: 0 in 0.449s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:18 devstack sudo[105632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00
Jul 19 20:03:18 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:18 devstack sudo[105626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_679opuxl
Jul 19 20:03:18 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:18 devstack sudo[105631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6
Jul 19 20:03:18 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (f96d1b76-1a2a-42d0-90b5-ed4e0e2aa33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843281bd-4ff2-4777-a371-9c76c25d0d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843281bd-4ff2-4777-a371-9c76c25d0d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281485426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f0f08d-8360-4835-b88b-f089d20a1d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:18Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f18832-7737-446a-af22-3d18e9e5c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f18832-7737-446a-af22-3d18e9e5c85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5481738b-b580-40e6-99af-347e05a38837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5481738b-b580-40e6-99af-347e05a38837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f0f08d-8360-4835-b88b-f089d20a1d70', 'volume_name': 'volume-71f0f08d-8360-4835-b88b-f089d20a1d70', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28933910-d1b9-4ab5-bc69-5d91c656393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28933910-d1b9-4ab5-bc69-5d91c656393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410e3897-b28a-44e1-9b32-33211774d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume 71f0f08d-8360-4835-b88b-f089d20a1d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f0f08d-8360-4835-b88b-f089d20a1d70', 'volume_size': 1}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:18 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_679opuxl" returned: 1 in 0.470s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_679opuxl' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[97107687-60cc-4909-a5fa-1b9836146e92]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:18 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-32b54fd2-ab1c-44f0-a4ba-6e143a188c00" returned: 0 in 0.381s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-32b54fd2-ab1c-44f0-a4ba-6e143a188c00" released by "delete_volume" :: held 0.886s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Created reservations ['d052b0a8-773b-4a44-a5cc-c836285a49fb', 'e56d5904-be42-4e16-91cd-6269e0b90253', '9a4d8ecc-2997-4885-9e6c-df3ecb5d9b06', '157829bb-766c-45da-a613-5665acc8539e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:18 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD
Jul 19 20:03:18 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:18 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6" returned: 0 in 0.606s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:18 devstack sudo[105644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb
Jul 19 20:03:18 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:18 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:18 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:18 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (9f43f41b-f5b6-4cc1-b440-1a9ea1cec248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700c8171-e235-4d4c-9769-8cd89bd16ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700c8171-e235-4d4c-9769-8cd89bd16ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-725581899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:19Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4a79e8-a98c-4e1f-ac6e-701432b8390b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4a79e8-a98c-4e1f-ac6e-701432b8390b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c171b6e-0eec-4034-808f-31c160ab8848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c171b6e-0eec-4034-808f-31c160ab8848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32', 'volume_name': 'volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bbab05-d632-443b-83a3-a199fa89487f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bbab05-d632-443b-83a3-a199fa89487f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd461b85-8a6c-4891-b397-b9d3e3822d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:19 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume 5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32', 'volume_size': 1}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:19 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.409s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:19 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD
Jul 19 20:03:19 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Deleted volume successfully.
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-147f484b-40c1-457e-a4ad-c0e7d006b035 tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-32b54fd2-ab1c-44f0-a4ba-6e143a188c00-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (b304bfb7-af3b-4752-8c4c-e73b102c1f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e17c809-8163-4f4b-9eef-6bdcb1687986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:19 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD" returned: 1 in 0.646s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] 9e594bdb-51a6-42ef-ba2e-adbac98c2a96 was raw, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e17c809-8163-4f4b-9eef-6bdcb1687986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1236422929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f20c29-cb56-4dca-8898-f8dabcbfe989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:19Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719e3255-8c10-48fb-8750-663681d41cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719e3255-8c10-48fb-8750-663681d41cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:19 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2
Jul 19 20:03:19 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf58756-e6f7-4b26-a5f4-4d9bf32becd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf58756-e6f7-4b26-a5f4-4d9bf32becd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f20c29-cb56-4dca-8898-f8dabcbfe989', 'volume_name': 'volume-02f20c29-cb56-4dca-8898-f8dabcbfe989', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6117affd-f3a8-4203-909a-63bef60c8961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6117affd-f3a8-4203-909a-63bef60c8961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6f9735-c30e-4bc5-b3fb-50c4a0b39efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:19 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume 02f20c29-cb56-4dca-8898-f8dabcbfe989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f20c29-cb56-4dca-8898-f8dabcbfe989', 'volume_size': 1}
Jul 19 20:03:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-2eea2762-0502-4de4-b628-a0531297e47c-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-2eea2762-0502-4de4-b628-a0531297e47c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "cinder-quobyte-2eea2762-0502-4de4-b628-a0531297e47c" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-2eea2762-0502-4de4-b628-a0531297e47c" acquired by "delete_volume" :: waited 0.052s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0234f5ed-4522-4c4a-9c96-011653a78f88]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (680c607b-3637-4dc7-8bb1-c4ca7459660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a81e9b-f719-485b-9f5d-f3295f44d45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a81e9b-f719-485b-9f5d-f3295f44d45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122169794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88592b2c-8f00-4d8b-8283-b08f71c1093e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:20Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75470f37-ba08-4d69-afa0-e38cd2d1e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75470f37-ba08-4d69-afa0-e38cd2d1e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d39592-1c23-42f8-ba54-69ded3a16df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d39592-1c23-42f8-ba54-69ded3a16df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88592b2c-8f00-4d8b-8283-b08f71c1093e', 'volume_name': 'volume-88592b2c-8f00-4d8b-8283-b08f71c1093e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c033bb9-5230-4312-b851-aacd1a44633e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c033bb9-5230-4312-b851-aacd1a44633e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd848654-88e9-478d-be81-a63be0565ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:20 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume 88592b2c-8f00-4d8b-8283-b08f71c1093e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88592b2c-8f00-4d8b-8283-b08f71c1093e', 'volume_size': 1}
Jul 19 20:03:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:20 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c
Jul 19 20:03:20 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:21 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2" returned: 0 in 1.618s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e594bdb-51a6-42ef-ba2e-adbac98c2a96_kwpumk4odevstack@QuobyteHD, size 0.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 20:03:21 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Converted 0.00 MB image at 0.00 MB/s
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:21 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 1G
Jul 19 20:03:21 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:21 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (c10fe9c3-8bfa-4dcc-a512-818006d87e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c93b78-af94-4c24-a41c-fd66a4346cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c" returned: 0 in 1.147s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c93b78-af94-4c24-a41c-fd66a4346cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220454806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3009d957-04d9-4fa6-85b1-04c9667eb64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:21Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:21 devstack sudo[105679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c
Jul 19 20:03:21 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c032ae-98aa-4648-b9a7-3582fc384272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c032ae-98aa-4648-b9a7-3582fc384272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c8a086-427f-4577-95a9-14c010396dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c8a086-427f-4577-95a9-14c010396dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3009d957-04d9-4fa6-85b1-04c9667eb64a', 'volume_name': 'volume-3009d957-04d9-4fa6-85b1-04c9667eb64a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d7e49b-174c-4da9-97b1-07bac25aebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d7e49b-174c-4da9-97b1-07bac25aebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e857c495-0f20-4002-90bb-b6d093ee4b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:21 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume 3009d957-04d9-4fa6-85b1-04c9667eb64a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3009d957-04d9-4fa6-85b1-04c9667eb64a', 'volume_size': 1}
Jul 19 20:03:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:22 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 1G" returned: 0 in 0.884s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Downloaded image 9e594bdb-51a6-42ef-ba2e-adbac98c2a96 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'metadata': {}}])) to volume efda6ce9-8a40-4976-aa16-8744b581c1c2 successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Temporary image 9e594bdb-51a6-42ef-ba2e-adbac98c2a96 for user 9d7675a27d0d4bc19bce7297516f8a32 is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Marking volume efda6ce9-8a40-4976-aa16-8744b581c1c2 as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Copying metadata from image 9e594bdb-51a6-42ef-ba2e-adbac98c2a96 to efda6ce9-8a40-4976-aa16-8744b581c1c2. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Creating volume glance metadata for volume efda6ce9-8a40-4976-aa16-8744b581c1c2 backed by image 9e594bdb-51a6-42ef-ba2e-adbac98c2a96 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0a34e3def3aa5804bd37c5b93be3ee70', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 20:03:22 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2eea2762-0502-4de4-b628-a0531297e47c" returned: 0 in 0.848s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab089c44-a1ef-4643-b075-1e15aaafb933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efda6ce9-8a40-4976-aa16-8744b581c1c2', 'volume_size': 1, 'image_id': '9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a34e3def3aa5804bd37c5b93be3ee70', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2b9ffc010fe43c59a7a51112cb09ee6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8ccd19d0432b69b0e032f25e27ca47c0c279d00e1bb76514d180ca9ca731a8c956574ccc54a095d927d52d495500a1353a0455248f7c795671edc6a7eec21b6d', 'id': '9e594bdb-51a6-42ef-ba2e-adbac98c2a96', 'created_at': datetime.datetime(2026, 7, 19, 18, 3, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 18, 3, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e594bdb-51a6-42ef-ba2e-adbac98c2a96/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442ca4fdd0>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74264806-3e96-4c4f-af04-234c126f0f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-quobyte-2eea2762-0502-4de4-b628-a0531297e47c" released by "delete_volume" :: held 2.183s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:22 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Volume volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 (efda6ce9-8a40-4976-aa16-8744b581c1c2): created successfully
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74264806-3e96-4c4f-af04-234c126f0f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Flow 'volume_create_manager' (bf06257a-bd4d-4e45-a5c2-9cc553a3f61d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-663902f7-6f64-4b9b-bce4-148b55f9485c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Created volume successfully.
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Created reservations ['a6062faf-0e5b-4170-9d24-fab0767a4b85', '2fa02c43-6e4a-458e-9bab-bfa75ac82094', '4b9e815b-30af-487f-b654-97ca20aeb405', '634ef58a-ad12-448d-bf1a-71aa21daa8e2'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Acquiring lock "cinder-efda6ce9-8a40-4976-aa16-8744b581c1c2-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "cinder-efda6ce9-8a40-4976-aa16-8744b581c1c2-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:23 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:23 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Acquiring lock "cinder-quobyte-efda6ce9-8a40-4976-aa16-8744b581c1c2" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "cinder-quobyte-efda6ce9-8a40-4976-aa16-8744b581c1c2" acquired by "delete_volume" :: waited 0.039s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e84fcb9-817b-4755-b8ad-0b2ff1995a03]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:23 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.456s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:23 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Deleted volume successfully.
Jul 19 20:03:23 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2
Jul 19 20:03:23 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6e4e3002-6c04-4bd5-8307-58b5195cbeca tempest-CreateVolumesFromImageTest-2125561430 None] Lock "cinder-2eea2762-0502-4de4-b628-a0531297e47c-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:23 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2" returned: 0 in 0.770s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:24 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2
Jul 19 20:03:24 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:24 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-efda6ce9-8a40-4976-aa16-8744b581c1c2" returned: 0 in 0.553s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:24 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "cinder-quobyte-efda6ce9-8a40-4976-aa16-8744b581c1c2" released by "delete_volume" :: held 1.427s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" returned: 0 in 5.894s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c840a15-af05-478e-91c8-7f100100bba1]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Created reservations ['25c67075-3334-47a7-a375-d0282b3d8cb7', '3d77c2ff-9fa6-4f7f-acbc-ac91e770f3f1', 'a10b276b-a310-4309-900f-108bb27e8450', 'f9cdf0ab-4c1e-4f54-87e3-26a01f081d33'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:24 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6
Jul 19 20:03:24 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:24 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:24 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:24 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.301s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Deleted volume successfully.
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-74f8aebe-8b44-4286-893a-2eac07d6436c tempest-VolumeAndVolumeTypeFromImageTest-1356066582 None] Lock "cinder-efda6ce9-8a40-4976-aa16-8744b581c1c2-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:25 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6" returned: 0 in 0.590s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 20:03:25 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Converted 1024.00 MB image at 173.68 MB/s
Jul 19 20:03:25 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb is being set with open permissions: ugo+rw
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:25 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb
Jul 19 20:03:25 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:25 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" returned: 0 in 0.349s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" released by "_copy_volume_from_snapshot" :: held 8.026s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-c1bddd20-d140-4052-ad86-7d3b01b05f84-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" released by "_create_volume_from_snapshot" :: held 8.071s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.126s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.143s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281485426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f0f08d-8360-4835-b88b-f089d20a1d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:18Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Creating volume 71f0f08d-8360-4835-b88b-f089d20a1d70 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:25 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:25 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70 1073741824
Jul 19 20:03:25 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e1002d-06c8-4a36-9a45-1302453e1df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb', 'volume_size': 1, 'snapshot_id': 'c1bddd20-d140-4052-ad86-7d3b01b05f84'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4bfba6-8234-4ddd-9dd8-a49c268e9f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:25 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Volume volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb (0f1a52cf-cabb-40ca-a272-5f3add2e5bcb): created successfully
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4bfba6-8234-4ddd-9dd8-a49c268e9f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:25 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Flow 'volume_create_manager' (ee959df2-2b8b-4a4d-8aa0-0f8f0afdd8b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0f51cd9c-6653-47ee-aec4-e50fd81d048d tempest-VolumeDependencyTests-2139354414 None] Created volume successfully.
Jul 19 20:03:26 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70 1073741824" returned: 0 in 0.523s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:26 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70
Jul 19 20:03:26 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:26 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.383s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-725581899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:19Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Creating volume 5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:26 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410e3897-b28a-44e1-9b32-33211774d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f0f08d-8360-4835-b88b-f089d20a1d70', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c99833-aee8-4e20-b0d6-2c49af2653a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:26 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32 1073741824
Jul 19 20:03:26 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:26 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume volume-71f0f08d-8360-4835-b88b-f089d20a1d70 (71f0f08d-8360-4835-b88b-f089d20a1d70): created successfully
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c99833-aee8-4e20-b0d6-2c49af2653a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (f96d1b76-1a2a-42d0-90b5-ed4e0e2aa33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-c1bddd20-d140-4052-ad86-7d3b01b05f84-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-c1bddd20-d140-4052-ad86-7d3b01b05f84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-quobyte-4808aed3-3362-4098-bb47-674647ffdab6" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:26 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-bf88585c-5b39-42a7-ae93-657353d71bd8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created volume successfully.
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-4808aed3-3362-4098-bb47-674647ffdab6" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-quobyte-c1bddd20-d140-4052-ad86-7d3b01b05f84" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-c1bddd20-d140-4052-ad86-7d3b01b05f84" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Deleting offline snapshot c1bddd20-d140-4052-ad86-7d3b01b05f84 of volume 4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] snapshot_file for this snap is: volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[29116eda-e1ca-49a0-b80e-6ca23a90a6b0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:26 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84
Jul 19 20:03:26 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:26 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32 1073741824" returned: 0 in 0.577s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:27 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32
Jul 19 20:03:27 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:27 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84" returned: 0 in 0.469s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4808aed3-3362-4098-bb47-674647ffdab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb569ee0-834d-4ba3-952e-6889c2f5baf9]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:27 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.507s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1236422929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f20c29-cb56-4dca-8898-f8dabcbfe989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:19Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Creating volume 02f20c29-cb56-4dca-8898-f8dabcbfe989 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:27 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6
Jul 19 20:03:27 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:27 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:27 devstack sudo[105773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989 1073741824
Jul 19 20:03:27 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd461b85-8a6c-4891-b397-b9d3e3822d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f6d4e2-4bc7-4bf3-97a7-f61fd478d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:27 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32 (5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32): created successfully
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f6d4e2-4bc7-4bf3-97a7-f61fd478d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (9f43f41b-f5b6-4cc1-b440-1a9ea1cec248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:27 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f35753d7-0fae-4ca6-9cde-09f81dcc2a66 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created volume successfully.
Jul 19 20:03:27 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6" returned: 0 in 0.497s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:27 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84
Jul 19 20:03:27 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:28 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989 1073741824" returned: 0 in 0.661s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:28 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989
Jul 19 20:03:28 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:28 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84" returned: 0 in 0.490s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:28 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84
Jul 19 20:03:28 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:28 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989" returned: 0 in 0.291s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.761s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122169794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88592b2c-8f00-4d8b-8283-b08f71c1093e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:20Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Creating volume 88592b2c-8f00-4d8b-8283-b08f71c1093e {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:28 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6f9735-c30e-4bc5-b3fb-50c4a0b39efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f20c29-cb56-4dca-8898-f8dabcbfe989', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39f5157-e000-46cb-ae92-c03da38da557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:28 devstack sudo[105792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e 1073741824
Jul 19 20:03:28 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:28 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume volume-02f20c29-cb56-4dca-8898-f8dabcbfe989 (02f20c29-cb56-4dca-8898-f8dabcbfe989): created successfully
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39f5157-e000-46cb-ae92-c03da38da557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (b304bfb7-af3b-4752-8c4c-e73b102c1f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-03161638-0a62-4eee-9e7b-1d3b0050654f tempest-CreateVolumesFromSnapshotTest-226694094 None] Created volume successfully.
Jul 19 20:03:28 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6.c1bddd20-d140-4052-ad86-7d3b01b05f84" returned: 0 in 0.374s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-c1bddd20-d140-4052-ad86-7d3b01b05f84" released by "_delete_snapshot" :: held 1.966s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-4808aed3-3362-4098-bb47-674647ffdab6" released by "delete_snapshot" :: held 2.013s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Created reservations ['e842be61-03e5-4b58-93d0-52f60bbdb67e', 'e0e51f8f-3a6a-43e1-9461-ef77d57a2e38', '3830ffc4-56f7-4d25-9998-2bb9dbc4f210', '58dbb37f-47f5-43f4-833d-32870900b4fb'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Delete snapshot completed successfully.
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-a1db4ad1-f136-411c-a3be-606eab6ab3f2 tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-c1bddd20-d140-4052-ad86-7d3b01b05f84-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:28 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e 1073741824" returned: 0 in 0.570s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:29 devstack sudo[105799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e
Jul 19 20:03:29 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:29 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.521s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220454806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3009d957-04d9-4fa6-85b1-04c9667eb64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06cbbe4c70bd4b019d7bd628e0fd71e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:21Z,use_quota=True,user_id='3b02ebf77a16428c8f41e42f3b331c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Creating volume 3009d957-04d9-4fa6-85b1-04c9667eb64a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:29 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd848654-88e9-478d-be81-a63be0565ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88592b2c-8f00-4d8b-8283-b08f71c1093e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9278520c-2076-4d2c-908b-29f4cc6b0c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:29 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a 1073741824
Jul 19 20:03:29 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:29 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume volume-88592b2c-8f00-4d8b-8283-b08f71c1093e (88592b2c-8f00-4d8b-8283-b08f71c1093e): created successfully
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9278520c-2076-4d2c-908b-29f4cc6b0c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (680c607b-3637-4dc7-8bb1-c4ca7459660b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:29 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-18a7236f-693e-42d4-8cfa-7976dc57fce1 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created volume successfully.
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-4808aed3-3362-4098-bb47-674647ffdab6-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-4808aed3-3362-4098-bb47-674647ffdab6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-quobyte-4808aed3-3362-4098-bb47-674647ffdab6" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:29 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a 1073741824" returned: 0 in 0.593s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-4808aed3-3362-4098-bb47-674647ffdab6" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528efd5-ea61-422c-9598-d41bf3fc2978]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:30 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a
Jul 19 20:03:30 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:30 devstack sudo[105807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6
Jul 19 20:03:30 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:30 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a" returned: 0 in 0.327s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e857c495-0f20-4002-90bb-b6d093ee4b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3009d957-04d9-4fa6-85b1-04c9667eb64a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ddbfd7-8f4f-45ff-b6ab-d660a786d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:30 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Volume volume-3009d957-04d9-4fa6-85b1-04c9667eb64a (3009d957-04d9-4fa6-85b1-04c9667eb64a): created successfully
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ddbfd7-8f4f-45ff-b6ab-d660a786d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Flow 'volume_create_manager' (c10fe9c3-8bfa-4dcc-a512-818006d87e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-061c5dd5-50a4-461e-982e-bc6e8eaef39c tempest-CreateVolumesFromSnapshotTest-226694094 None] Created volume successfully.
Jul 19 20:03:30 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6" returned: 0 in 0.500s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:30 devstack sudo[105815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6
Jul 19 20:03:30 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:30 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-4808aed3-3362-4098-bb47-674647ffdab6" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-4808aed3-3362-4098-bb47-674647ffdab6" released by "delete_volume" :: held 0.882s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Created reservations ['cf66f581-521b-473b-a480-da82c7f9887c', '03056b79-69a3-434c-81e6-67e921ee5d4a', 'c020f26e-895d-4112-b3fe-95bb4167211b', '4baac6a5-2bee-4d86-bb6e-4a56cdbc38bd'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:30 devstack sudo[105818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:30 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "cinder-quobyte-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58ba10e-13ab-4c27-afbe-27996e86f71e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:31 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.405s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Deleted volume successfully.
Jul 19 20:03:31 devstack sudo[105820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb
Jul 19 20:03:31 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83376198-d0e1-40cc-8378-ebdc781ded0e tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-4808aed3-3362-4098-bb47-674647ffdab6-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-3009d957-04d9-4fa6-85b1-04c9667eb64a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-3009d957-04d9-4fa6-85b1-04c9667eb64a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-quobyte-3009d957-04d9-4fa6-85b1-04c9667eb64a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-3009d957-04d9-4fa6-85b1-04c9667eb64a" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[199422b4-959c-467d-9d78-da30464bafeb]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:31 devstack sudo[105823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a
Jul 19 20:03:31 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e2f493a1-8a32-49de-8023-89b287d9991c tempest-ProjectAdminTests-1586911100 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87353) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 19 20:03:31 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" returned: 0 in 0.527s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:31 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb
Jul 19 20:03:31 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:31 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a" returned: 0 in 0.431s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:32 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a
Jul 19 20:03:32 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:32 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" returned: 0 in 0.314s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-quobyte-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb" released by "delete_volume" :: held 0.907s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Created reservations ['9777494b-54c5-4158-818d-9e1f9a1e588e', '1df79c1c-d17c-400c-92f0-7f87fbf60d98', '28b6c33e-55c9-49c3-becb-5256c8135850', '39e4b4be-779d-43e0-828d-d993373f2ff3'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:32 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:32 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:32 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3009d957-04d9-4fa6-85b1-04c9667eb64a" returned: 0 in 0.341s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-3009d957-04d9-4fa6-85b1-04c9667eb64a" released by "delete_volume" :: held 0.822s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Created reservations ['3e79f9b6-6b9b-442e-98c4-ba9a9be15725', '17391c5d-eb8c-42c6-947a-65a3c835fac5', 'bc6d1122-923e-4058-9e63-b4dbc9ec9efa', '638f7cce-072f-41e9-853f-acc7c8263ee1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:32 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:32 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:32 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.396s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Deleted volume successfully.
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-23ad5002-fdfd-4ecc-ad95-18bf995dff2c tempest-VolumeDependencyTests-2139354414 None] Lock "cinder-0f1a52cf-cabb-40ca-a272-5f3add2e5bcb-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-88592b2c-8f00-4d8b-8283-b08f71c1093e-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-88592b2c-8f00-4d8b-8283-b08f71c1093e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-quobyte-88592b2c-8f00-4d8b-8283-b08f71c1093e" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-88592b2c-8f00-4d8b-8283-b08f71c1093e" acquired by "delete_volume" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[13216b4f-0b51-4ad0-84b3-5c890564cedf]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:32 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:32 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:32 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.418s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:32 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Deleted volume successfully.
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3912389d-3d41-47e1-99c7-07588a49487b tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-3009d957-04d9-4fa6-85b1-04c9667eb64a-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:33 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e
Jul 19 20:03:33 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:33 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.419s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 20:03:33 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e" returned: 0 in 0.612s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:33 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e
Jul 19 20:03:33 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:33 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-88592b2c-8f00-4d8b-8283-b08f71c1093e" returned: 0 in 0.321s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-88592b2c-8f00-4d8b-8283-b08f71c1093e" released by "delete_volume" :: held 1.002s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:33 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Created reservations ['3b32f700-e9ad-4cb1-bbf3-35a5274b5692', 'd0630df7-35a9-4bcc-a4d8-f7f9301ad620', '1b8a982b-785d-4921-a27a-399d57acc2ee', '444fb848-fadf-4c7a-842b-aa9329d64ede'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:34 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:34 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:34 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.278s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Deleted volume successfully.
Jul 19 20:03:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c64b0d56-02a6-42c0-a4ee-637dbc3defbe tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-88592b2c-8f00-4d8b-8283-b08f71c1093e-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-02f20c29-cb56-4dca-8898-f8dabcbfe989-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-02f20c29-cb56-4dca-8898-f8dabcbfe989-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-quobyte-02f20c29-cb56-4dca-8898-f8dabcbfe989" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-02f20c29-cb56-4dca-8898-f8dabcbfe989" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[21844729-4995-48dd-beee-c36fa475b86f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:35 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989
Jul 19 20:03:35 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:35 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989" returned: 0 in 0.385s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:35 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989
Jul 19 20:03:35 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:35 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-02f20c29-cb56-4dca-8898-f8dabcbfe989" returned: 0 in 0.282s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-02f20c29-cb56-4dca-8898-f8dabcbfe989" released by "delete_volume" :: held 0.716s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:35 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created reservations ['50bac0db-2a9f-4bb3-b35b-6dc49b4adad0', '72a4e4b2-d21b-4271-ac8d-351f5549f723', '7a0aec5f-0337-40c9-81ed-931efcf6848a', 'bd79da5a-bdf7-4ec7-9bea-327b3c126edb'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:36 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:36 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-quobyte-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32" acquired by "delete_volume" :: waited 0.035s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdb20d6-240e-4642-9d76-98b9b6e7034a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:36 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.392s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Deleted volume successfully.
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e0e39fcb-617b-4f07-b43d-503afe2e07c8 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-02f20c29-cb56-4dca-8898-f8dabcbfe989-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:36 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32
Jul 19 20:03:36 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:36 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32" returned: 0 in 0.478s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:36 devstack sudo[105881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32
Jul 19 20:03:36 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:37 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32" returned: 0 in 0.285s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32" released by "delete_volume" :: held 0.829s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created reservations ['17f29d23-cd1f-42e0-a1ec-be86166c2e5d', '8b52b5c1-ab5e-4f5a-a849-833d02bac71d', 'e8659695-162b-4da6-8083-53efe6811148', 'b61d08ef-123b-4184-942b-f6a79c76ffa2'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:37 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:37 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (120bdc38-0c19-4ee7-a5d1-45312be74c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50f8fc7-c6eb-4a26-9848-fb5cadf2b2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50f8fc7-c6eb-4a26-9848-fb5cadf2b2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-900178056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9d3bbf-4143-4d7b-8a85-0b4c597604b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:37Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305db883-167b-40f2-a12c-f140dd416342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305db883-167b-40f2-a12c-f140dd416342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370189c6-cd15-4565-856b-cea18b212a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370189c6-cd15-4565-856b-cea18b212a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d9d3bbf-4143-4d7b-8a85-0b4c597604b9', 'volume_name': 'volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56241e1f-3482-4950-8699-ccb9379a8929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56241e1f-3482-4950-8699-ccb9379a8929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a307609-cb33-40c0-9b35-9ffd5d0034d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Volume 3d9d3bbf-4143-4d7b-8a85-0b4c597604b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9', 'volume_size': 1}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-900178056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9d3bbf-4143-4d7b-8a85-0b4c597604b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:37Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Creating volume 3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:37 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:37 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 1073741824
Jul 19 20:03:37 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:37 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.277s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Deleted volume successfully.
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8e5c593b-1ea6-428c-95df-88ede75dba45 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-5ed04cd9-39f9-49f9-a1aa-bf8675a0bb32-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-71f0f08d-8360-4835-b88b-f089d20a1d70-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-71f0f08d-8360-4835-b88b-f089d20a1d70-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:37 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 1073741824" returned: 0 in 0.498s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:37 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-quobyte-71f0f08d-8360-4835-b88b-f089d20a1d70" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-71f0f08d-8360-4835-b88b-f089d20a1d70" acquired by "delete_volume" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4ec54-c875-43a5-b2d0-5d64956ff761]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:38 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9
Jul 19 20:03:38 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:38 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70
Jul 19 20:03:38 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:38 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70" returned: 0 in 0.404s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:38 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" returned: 0 in 0.401s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:38 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70
Jul 19 20:03:38 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a307609-cb33-40c0-9b35-9ffd5d0034d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2d5873-2ffa-449b-b070-d2a6e27f642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:38 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Volume volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 (3d9d3bbf-4143-4d7b-8a85-0b4c597604b9): created successfully
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2d5873-2ffa-449b-b070-d2a6e27f642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (120bdc38-0c19-4ee7-a5d1-45312be74c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6cec7143-afd1-4b35-bf33-05e1ed05c578 tempest-ProjectReaderTests-1650706838 None] Created volume successfully.
Jul 19 20:03:38 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-71f0f08d-8360-4835-b88b-f089d20a1d70" returned: 0 in 0.270s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-71f0f08d-8360-4835-b88b-f089d20a1d70" released by "delete_volume" :: held 0.728s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created reservations ['9275ed55-a554-4254-b0c0-657420f1c265', '4da76ce5-2c95-40f1-b7bd-f8b8eee6dbc9', 'a60b1881-51a5-4420-a491-e07d95243bc6', '237fd597-7526-41ac-969b-1b4cfc743dbe'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:38 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:38 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-e0ea95e5-d64c-4e60-b665-5da6eb1fd342-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-e0ea95e5-d64c-4e60-b665-5da6eb1fd342-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-quobyte-69ee6d22-39c1-4825-8c73-0cef02492415" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-69ee6d22-39c1-4825-8c73-0cef02492415" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-quobyte-e0ea95e5-d64c-4e60-b665-5da6eb1fd342" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-e0ea95e5-d64c-4e60-b665-5da6eb1fd342" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Deleting offline snapshot e0ea95e5-d64c-4e60-b665-5da6eb1fd342 of volume 69ee6d22-39c1-4825-8c73-0cef02492415 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:03:39 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] snapshot_file for this snap is: volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.295s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Deleted volume successfully.
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aafe8f3-692c-4bfc-a668-0ea547fdd8f2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d329ed31-a437-4ce7-a397-9ac499cf4676 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-71f0f08d-8360-4835-b88b-f089d20a1d70-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:39 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342
Jul 19 20:03:39 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:39 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342" returned: 0 in 0.439s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69ee6d22-39c1-4825-8c73-0cef02492415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e594b550-fa73-47b1-9e33-267364f6316d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:39 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415
Jul 19 20:03:39 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Flow 'volume_create_manager' (db777b42-7c47-4112-b6c8-ca0f444516a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22888fb8-a253-4901-85f1-1a05064cc9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Creating offline snapshot 00942dc4-3e92-4cab-aeb8-73cf032f3e99 of volume 3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22888fb8-a253-4901-85f1-1a05064cc9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c1f939-9051-4be2-9ee1-0903e01d84c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4951e49c749f4a3ebbfd672bf00b28b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:40Z,use_quota=True,user_id='6ddb4c915a864b91b5d24653601bbbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c93641a-fc3c-4ff0-9c8f-47ef5f3d5803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c93641a-fc3c-4ff0-9c8f-47ef5f3d5803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3cd161-b5cf-4c35-b3dd-c1303eef1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG cinder.image.glance [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Creating Keystone auth plugin from conf {{(pid=87353) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b953d-dc30-4b51-8235-16d49588e616]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:40 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9
Jul 19 20:03:40 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:40 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415" returned: 0 in 0.401s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:40 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342
Jul 19 20:03:40 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:40 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" returned: 0 in 0.449s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3cd161-b5cf-4c35-b3dd-c1303eef1f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29c1f939-9051-4be2-9ee1-0903e01d84c8', 'volume_name': 'volume-29c1f939-9051-4be2-9ee1-0903e01d84c8', 'volume_size': 1, 'image_id': 'f102c997-c543-46e5-a640-5e082558a00f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f102c997-c543-46e5-a640-5e082558a00f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67147e25c619a0dd5c4e109cc287e06f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4951e49c749f4a3ebbfd672bf00b28b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2641d586006758648afa1acf1bcf2768cf9bdade6697de37ac7bd872c4df3bdc4a682cc4f0c6f6a31ed42d5ee3556f0c14a8d9b3518640795e09c2ed6edca17e', 'id': 'f102c997-c543-46e5-a640-5e082558a00f', 'created_at': datetime.datetime(2026, 7, 19, 18, 3, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 18, 3, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f102c997-c543-46e5-a640-5e082558a00f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cb97020>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca63e8e3-42a5-4552-bdda-5011d9466f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca63e8e3-42a5-4552-bdda-5011d9466f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:40 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 1G
Jul 19 20:03:40 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac58f263-c12f-4bf1-ab11-e14edab1647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:40 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Volume 29c1f939-9051-4be2-9ee1-0903e01d84c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29c1f939-9051-4be2-9ee1-0903e01d84c8', 'volume_size': 1, 'image_id': 'f102c997-c543-46e5-a640-5e082558a00f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f102c997-c543-46e5-a640-5e082558a00f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67147e25c619a0dd5c4e109cc287e06f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4951e49c749f4a3ebbfd672bf00b28b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2641d586006758648afa1acf1bcf2768cf9bdade6697de37ac7bd872c4df3bdc4a682cc4f0c6f6a31ed42d5ee3556f0c14a8d9b3518640795e09c2ed6edca17e', 'id': 'f102c997-c543-46e5-a640-5e082558a00f', 'created_at': datetime.datetime(2026, 7, 19, 18, 3, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 18, 3, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f102c997-c543-46e5-a640-5e082558a00f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cb97020>}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Trying to clone 29c1f939-9051-4be2-9ee1-0903e01d84c8 from image f102c997-c543-46e5-a640-5e082558a00f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f102c997-c543-46e5-a640-5e082558a00f', 'metadata': {}}]). {{(pid=87353) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 19 20:03:40 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Image download 0.00 MB at 0.00 MB/s
Jul 19 20:03:40 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342" returned: 0 in 0.488s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[de733ee6-1118-4410-92f9-10154eb6bbd7]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:40 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342
Jul 19 20:03:40 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:40 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD
Jul 19 20:03:40 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:40 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415.e0ea95e5-d64c-4e60-b665-5da6eb1fd342" returned: 0 in 0.269s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-e0ea95e5-d64c-4e60-b665-5da6eb1fd342" released by "_delete_snapshot" :: held 1.734s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:40 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-69ee6d22-39c1-4825-8c73-0cef02492415" released by "delete_snapshot" :: held 1.762s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 1G" returned: 0 in 0.542s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:40 devstack sudo[105938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99
Jul 19 20:03:40 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:40 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created reservations ['234de18c-a38a-4b89-90a1-731ae1015906', 'c9efdf76-d3ee-413e-952b-91074620098c', '10acc6f6-6313-41b0-ac37-63b179f72cc7', 'c84b5f75-d53c-43dc-8aef-3c49bd4d5ade'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Delete snapshot completed successfully.
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-71bb3e21-1600-4f1f-92cb-069ecd16ea20 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-e0ea95e5-d64c-4e60-b665-5da6eb1fd342-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:41 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD
Jul 19 20:03:41 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:41 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99" returned: 0 in 0.369s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:41 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 is being set with open permissions: ugo+rw
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-69ee6d22-39c1-4825-8c73-0cef02492415-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:41 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99
Jul 19 20:03:41 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-69ee6d22-39c1-4825-8c73-0cef02492415-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:41 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Temporary image f102c997-c543-46e5-a640-5e082558a00f is fetched for user 6ddb4c915a864b91b5d24653601bbbe3. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "cinder-quobyte-69ee6d22-39c1-4825-8c73-0cef02492415" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-69ee6d22-39c1-4825-8c73-0cef02492415" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c242f75-46ef-43d2-94b0-b8684b0c71f9]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a253eb-bec1-4d17-b414-40a41b0b076a]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:41 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99" returned: 0 in 0.333s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:41 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415
Jul 19 20:03:41 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:41 devstack sudo[105954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD
Jul 19 20:03:41 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:41 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.info
Jul 19 20:03:41 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:41 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415" returned: 0 in 0.434s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:41 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.info" returned: 0 in 0.315s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:41 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.info is being set with open permissions: ugo+rw
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:41 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:41 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:41 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:41 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.info
Jul 19 20:03:41 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:42 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD
Jul 19 20:03:42 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:42 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:42 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-69ee6d22-39c1-4825-8c73-0cef02492415" returned: 0 in 0.321s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.info" returned: 0 in 0.296s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-quobyte-69ee6d22-39c1-4825-8c73-0cef02492415" released by "delete_volume" :: held 0.858s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c0500db8-bcad-4493-954e-02ef2c80c154 tempest-ProjectReaderTests-1650706838 None] Create snapshot completed successfully
Jul 19 20:03:42 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c1f939-9051-4be2-9ee1-0903e01d84c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4951e49c749f4a3ebbfd672bf00b28b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:40Z,use_quota=True,user_id='6ddb4c915a864b91b5d24653601bbbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Creating volume 29c1f939-9051-4be2-9ee1-0903e01d84c8 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:42 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Created reservations ['efda6e99-aada-4425-bc0d-3aba2ed101a0', '562d5412-967a-433a-a333-fdbeabfeb248', '90b7ee53-5e57-4687-8b9d-0c4c5a200967', 'ec8f15c6-0718-44dc-a668-66a7b344c830'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:42 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 1073741824
Jul 19 20:03:42 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:42 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:42 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:42 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:42 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Deleted volume successfully.
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-bccc88c4-05cf-4942-b995-52f75362ee60 tempest-CreateVolumesFromSnapshotTest-226694094 None] Lock "cinder-69ee6d22-39c1-4825-8c73-0cef02492415-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:42 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 1073741824" returned: 0 in 0.565s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:43 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8
Jul 19 20:03:43 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-00942dc4-3e92-4cab-aeb8-73cf032f3e99-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:43 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-00942dc4-3e92-4cab-aeb8-73cf032f3e99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-00942dc4-3e92-4cab-aeb8-73cf032f3e99" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Attempting download of f102c997-c543-46e5-a640-5e082558a00f ((None, [{'url': 'file:///opt/stack/data/glance/images/f102c997-c543-46e5-a640-5e082558a00f', 'metadata': {}}])) to volume 29c1f939-9051-4be2-9ee1-0903e01d84c8. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-00942dc4-3e92-4cab-aeb8-73cf032f3e99" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Deleting offline snapshot 00942dc4-3e92-4cab-aeb8-73cf032f3e99 of volume 3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] snapshot_file for this snap is: volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9879cd5-dffa-4f00-a639-3b479e1f73d5]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82050cb-6c25-4b00-8a98-a0d84611449c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f102c997-c543-46e5-a640-5e082558a00f_ebgi512k {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:43 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f102c997-c543-46e5-a640-5e082558a00f_ebgi512k
Jul 19 20:03:43 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:43 devstack sudo[105991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99
Jul 19 20:03:43 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:43 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f102c997-c543-46e5-a640-5e082558a00f_ebgi512k" returned: 0 in 0.385s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f102c997-c543-46e5-a640-5e082558a00f_ebgi512k {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:43 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99" returned: 0 in 0.447s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[885d1347-def3-4b4c-8dce-1f0990bea0ee]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:43 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f102c997-c543-46e5-a640-5e082558a00f_ebgi512k
Jul 19 20:03:43 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:44 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9
Jul 19 20:03:44 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:44 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f102c997-c543-46e5-a640-5e082558a00f_ebgi512k" returned: 1 in 0.455s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f102c997-c543-46e5-a640-5e082558a00f_ebgi512k' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2711b74f-1ae9-49e9-af86-21587248a733]: (4, 'raw') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:44 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" returned: 0 in 0.443s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:44 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99
Jul 19 20:03:44 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:44 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD
Jul 19 20:03:44 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:44 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:44 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD
Jul 19 20:03:44 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:44 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99" returned: 0 in 0.460s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:44 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99
Jul 19 20:03:44 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:45 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] f102c997-c543-46e5-a640-5e082558a00f was raw, converting to qcow2 {{(pid=87353) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:45 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8
Jul 19 20:03:45 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:45 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9.00942dc4-3e92-4cab-aeb8-73cf032f3e99" returned: 0 in 0.378s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-00942dc4-3e92-4cab-aeb8-73cf032f3e99" released by "_delete_snapshot" :: held 1.909s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" released by "delete_snapshot" :: held 1.950s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Created reservations ['20674931-407d-4738-a861-457b0b37dbff', '260cbc2f-0490-41f8-b3bc-0e6031dee4b7', 'ad5edb06-00ea-4b9e-89b6-2f6c588743f1', '7abad033-cd1d-411a-93ff-8882a1a68cae'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Flow 'volume_create_manager' (cbc92187-78a5-4ee4-a5a8-42395e506078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f30454-a5ea-4241-a9a4-7acfd1f7b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f30454-a5ea-4241-a9a4-7acfd1f7b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658743394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1691eb0-2e92-479b-9fcc-1f9c915b564b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851ba70f8f364f08a59fe34a57e9f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:45Z,use_quota=True,user_id='0d2dd663738b4b8f86454776dcb233f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fa4cd1-0ca6-4d33-b79c-b6f951a8828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fa4cd1-0ca6-4d33-b79c-b6f951a8828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2596b43f-2daa-4aa4-9cf5-6f78033d40d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2596b43f-2daa-4aa4-9cf5-6f78033d40d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1691eb0-2e92-479b-9fcc-1f9c915b564b', 'volume_name': 'volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed96787a-7142-4f4f-ad4f-fbd68bce387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed96787a-7142-4f4f-ad4f-fbd68bce387d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b72745-329e-4c23-9239-6a41d99a8bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:45 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Volume e1691eb0-2e92-479b-9fcc-1f9c915b564b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b', 'volume_size': 1}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658743394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1691eb0-2e92-479b-9fcc-1f9c915b564b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851ba70f8f364f08a59fe34a57e9f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:45Z,use_quota=True,user_id='0d2dd663738b4b8f86454776dcb233f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Creating volume e1691eb0-2e92-479b-9fcc-1f9c915b564b {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:45 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:45 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Delete snapshot completed successfully.
Jul 19 20:03:45 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b 1073741824
Jul 19 20:03:45 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-83998d30-e9bf-4c35-b0e1-5d9ec6582956 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-00942dc4-3e92-4cab-aeb8-73cf032f3e99-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:45 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8" returned: 0 in 0.580s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f102c997-c543-46e5-a640-5e082558a00f_q6pxyy3bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 20:03:45 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Converted 0.00 MB image at 0.00 MB/s
Jul 19 20:03:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:45 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 1G
Jul 19 20:03:45 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:46 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b 1073741824" returned: 0 in 0.481s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:46 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 1G" returned: 0 in 0.353s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Downloaded image f102c997-c543-46e5-a640-5e082558a00f ((None, [{'url': 'file:///opt/stack/data/glance/images/f102c997-c543-46e5-a640-5e082558a00f', 'metadata': {}}])) to volume 29c1f939-9051-4be2-9ee1-0903e01d84c8 successfully. {{(pid=87353) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Temporary image f102c997-c543-46e5-a640-5e082558a00f for user 6ddb4c915a864b91b5d24653601bbbe3 is deleted. {{(pid=87353) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.volume_utils [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Marking volume 29c1f939-9051-4be2-9ee1-0903e01d84c8 as bootable. {{(pid=87353) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 19 20:03:46 devstack sudo[106047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b
Jul 19 20:03:46 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Copying metadata from image f102c997-c543-46e5-a640-5e082558a00f to 29c1f939-9051-4be2-9ee1-0903e01d84c8. {{(pid=87353) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Creating volume glance metadata for volume 29c1f939-9051-4be2-9ee1-0903e01d84c8 backed by image f102c997-c543-46e5-a640-5e082558a00f with: {'image_id': 'f102c997-c543-46e5-a640-5e082558a00f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '67147e25c619a0dd5c4e109cc287e06f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87353) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (13dd7cf3-9b2e-44ba-91d1-2518840e026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcb2977-2a3d-4845-a297-adb1194a2470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcb2977-2a3d-4845-a297-adb1194a2470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480710005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaac6e9-26a7-4077-a0c6-65afe5ad8f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:46Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863cc7a6-0769-4a08-b371-f5c998b8b8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863cc7a6-0769-4a08-b371-f5c998b8b8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffdee98-6619-4ca1-be85-29683348c6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffdee98-6619-4ca1-be85-29683348c6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baaac6e9-26a7-4077-a0c6-65afe5ad8f02', 'volume_name': 'volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc21db6-b518-48b9-99ec-8b0665679a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc21db6-b518-48b9-99ec-8b0665679a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc671b8-3229-420b-a92d-93af970c13d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume baaac6e9-26a7-4077-a0c6-65afe5ad8f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02', 'volume_size': 1}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac58f263-c12f-4bf1-ab11-e14edab1647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c1f939-9051-4be2-9ee1-0903e01d84c8', 'volume_size': 1, 'image_id': 'f102c997-c543-46e5-a640-5e082558a00f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f102c997-c543-46e5-a640-5e082558a00f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67147e25c619a0dd5c4e109cc287e06f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4951e49c749f4a3ebbfd672bf00b28b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2641d586006758648afa1acf1bcf2768cf9bdade6697de37ac7bd872c4df3bdc4a682cc4f0c6f6a31ed42d5ee3556f0c14a8d9b3518640795e09c2ed6edca17e', 'id': 'f102c997-c543-46e5-a640-5e082558a00f', 'created_at': datetime.datetime(2026, 7, 19, 18, 3, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 19, 18, 3, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f102c997-c543-46e5-a640-5e082558a00f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f442cb97020>}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4002728c-0b3a-4bc7-8968-fae1ab31f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Volume volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 (29c1f939-9051-4be2-9ee1-0903e01d84c8): created successfully
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4002728c-0b3a-4bc7-8968-fae1ab31f792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Flow 'volume_create_manager' (db777b42-7c47-4112-b6c8-ca0f444516a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b49a4f4b-cdea-474e-8b04-8661ecf54fcc tempest-VolumeImageDependencyTests-1634787581 None] Created volume successfully.
Jul 19 20:03:46 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b" returned: 0 in 0.263s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480710005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaac6e9-26a7-4077-a0c6-65afe5ad8f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:46Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Creating volume baaac6e9-26a7-4077-a0c6-65afe5ad8f02 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:46 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b72745-329e-4c23-9239-6a41d99a8bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:46 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02 1073741824
Jul 19 20:03:46 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe40d5b6-7e88-4c57-9015-6803747a322a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:46 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Volume volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b (e1691eb0-2e92-479b-9fcc-1f9c915b564b): created successfully
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe40d5b6-7e88-4c57-9015-6803747a322a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Flow 'volume_create_manager' (cbc92187-78a5-4ee4-a5a8-42395e506078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-056f3533-1c5e-4e92-8350-43bb1643ab1e tempest-ProjectReaderTests-78506003 None] Created volume successfully.
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5387e0-d6e3-430d-958d-aa972925a63e]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:46 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9
Jul 19 20:03:46 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:46 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02 1073741824" returned: 0 in 0.447s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:46 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02
Jul 19 20:03:46 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:46 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" returned: 0 in 0.377s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:46 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9
Jul 19 20:03:46 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:47 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc671b8-3229-420b-a92d-93af970c13d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e560acc-2fff-4f6e-8c67-30e308ad0691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:47 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02 (baaac6e9-26a7-4077-a0c6-65afe5ad8f02): created successfully
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e560acc-2fff-4f6e-8c67-30e308ad0691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (13dd7cf3-9b2e-44ba-91d1-2518840e026a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-556510ad-4824-4a8a-b402-9424e84b26a9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created volume successfully.
Jul 19 20:03:47 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9" released by "delete_volume" :: held 0.681s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Created reservations ['0da8b84d-d467-4d11-a17d-b99e7ed6e689', '0dc8095b-ff56-428d-9a94-c9ed7d98d669', '9e640c6f-d326-4aae-8e90-e9d6bab863ce', 'd6fde460-ba50-4477-b90d-e578187842cb'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:47 devstack sudo[106066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:47 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Acquiring lock "cinder-29c1f939-9051-4be2-9ee1-0903e01d84c8-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Lock "cinder-29c1f939-9051-4be2-9ee1-0903e01d84c8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Acquiring lock "cinder-quobyte-29c1f939-9051-4be2-9ee1-0903e01d84c8" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Lock "cinder-quobyte-29c1f939-9051-4be2-9ee1-0903e01d84c8" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb1e078-3422-4f37-8791-cd940ba77b2f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:47 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.307s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Deleted volume successfully.
Jul 19 20:03:47 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8
Jul 19 20:03:47 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0b29424b-cba2-4e9e-9794-c297a90e5438 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-3d9d3bbf-4143-4d7b-8a85-0b4c597604b9-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Acquiring lock "cinder-e1691eb0-2e92-479b-9fcc-1f9c915b564b-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Lock "cinder-e1691eb0-2e92-479b-9fcc-1f9c915b564b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Acquiring lock "cinder-quobyte-e1691eb0-2e92-479b-9fcc-1f9c915b564b" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Lock "cinder-quobyte-e1691eb0-2e92-479b-9fcc-1f9c915b564b" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[55169d0c-f7e4-4dfb-90c9-67a1d6bd6e5c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:47 devstack sudo[106071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b
Jul 19 20:03:47 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:47 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8" returned: 0 in 0.461s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:48 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8
Jul 19 20:03:48 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:48 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (671f57b0-103d-4637-87b9-6ccc3c86c1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a8787d-2f10-4b6e-84c5-6829caa2a34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b" returned: 0 in 0.446s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:48 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:48 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a8787d-2f10-4b6e-84c5-6829caa2a34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-927843248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd3b824-2c56-4d9c-92a3-87fe68944bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:48Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:48 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f9ebfb-d0ae-4773-91ce-08b7cb62c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f9ebfb-d0ae-4773-91ce-08b7cb62c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c687010-cd2e-49ef-be24-8a55c3b5ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c687010-cd2e-49ef-be24-8a55c3b5ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd3b824-2c56-4d9c-92a3-87fe68944bcf', 'volume_name': 'volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ab3974-486a-4cfb-ae45-0bec068063cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ab3974-486a-4cfb-ae45-0bec068063cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84dd341b-5ff2-414f-8eed-815841d913d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Volume ffd3b824-2c56-4d9c-92a3-87fe68944bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf', 'volume_size': 1}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-927843248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd3b824-2c56-4d9c-92a3-87fe68944bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:48Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Creating volume ffd3b824-2c56-4d9c-92a3-87fe68944bcf {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:48 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-29c1f939-9051-4be2-9ee1-0903e01d84c8" returned: 0 in 0.374s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Lock "cinder-quobyte-29c1f939-9051-4be2-9ee1-0903e01d84c8" released by "delete_volume" :: held 0.880s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:48 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf 1073741824
Jul 19 20:03:48 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Created reservations ['889c2619-b815-43f8-87e3-5314814af31f', 'c04558fc-d3a0-4b70-8587-8fa4712fcb75', '4544ef37-526e-45a8-9c57-df1bfe75dba3', 'b280f064-3154-4815-adbb-85ca9f1d770e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:48 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:48 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:48 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-e1691eb0-2e92-479b-9fcc-1f9c915b564b" returned: 0 in 0.362s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Lock "cinder-quobyte-e1691eb0-2e92-479b-9fcc-1f9c915b564b" released by "delete_volume" :: held 0.868s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Created reservations ['c30b811a-5c3f-4ff8-9686-540e7f283670', '2e827bd8-04fb-4715-923f-9a71975d0a0e', '46b0767d-ec6b-4215-854d-446d16af810c', '13820961-f77d-4229-bec3-7ff0ede5004f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (b09c9ef3-fdba-4d63-bb45-ff7b6348c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bde61fc-06c3-4bfc-853e-e256ab4582de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bde61fc-06c3-4bfc-853e-e256ab4582de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744701179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb6efff-80f5-4ae0-b6e0-478c92b1d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:49Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb3d25c-1670-4001-986a-2399606f8a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb3d25c-1670-4001-986a-2399606f8a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8aa0ee-f394-4b26-b603-bb13eef6a40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8aa0ee-f394-4b26-b603-bb13eef6a40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb6efff-80f5-4ae0-b6e0-478c92b1d626', 'volume_name': 'volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ce8d17-199a-4ea4-8685-4301944a0bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ce8d17-199a-4ea4-8685-4301944a0bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dd7988-53dc-4a43-bd73-b183d065bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:48 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume adb6efff-80f5-4ae0-b6e0-478c92b1d626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626', 'volume_size': 1}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:48 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.430s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Deleted volume successfully.
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3e369e0b-b309-4617-afac-ff9aeb3d596c tempest-VolumeImageDependencyTests-1634787581 None] Lock "cinder-29c1f939-9051-4be2-9ee1-0903e01d84c8-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:49 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:49 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:49 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf 1073741824" returned: 0 in 0.772s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:49 devstack sudo[106096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf
Jul 19 20:03:49 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:49 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Deleted volume successfully.
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6d27bf4e-44a6-43ac-986a-4ef01d714bb6 tempest-ProjectReaderTests-78506003 None] Lock "cinder-e1691eb0-2e92-479b-9fcc-1f9c915b564b-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:49 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" returned: 0 in 0.385s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744701179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb6efff-80f5-4ae0-b6e0-478c92b1d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:49Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Creating volume adb6efff-80f5-4ae0-b6e0-478c92b1d626 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:49 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:49 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626 1073741824
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84dd341b-5ff2-414f-8eed-815841d913d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:49 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b69308-5a48-4736-88ec-b1ae8853186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:49 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Volume volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf (ffd3b824-2c56-4d9c-92a3-87fe68944bcf): created successfully
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b69308-5a48-4736-88ec-b1ae8853186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (671f57b0-103d-4637-87b9-6ccc3c86c1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-febeb239-8478-43a9-becd-375585a7ea67 tempest-ProjectReaderTests-1650706838 None] Created volume successfully.
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (c8a53273-d050-43b6-903b-d95574b9588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d045eb75-5995-4ae8-9e4b-f09cef89555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d045eb75-5995-4ae8-9e4b-f09cef89555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712090683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876b31db-3334-4fc2-a1f8-2914d3476c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:50Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990f681d-bf81-46f3-9301-36795206a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990f681d-bf81-46f3-9301-36795206a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db1b1f6-0381-456e-8be3-094a7a1e59dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db1b1f6-0381-456e-8be3-094a7a1e59dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876b31db-3334-4fc2-a1f8-2914d3476c77', 'volume_name': 'volume-876b31db-3334-4fc2-a1f8-2914d3476c77', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4a4620-a83e-43ef-a7be-2eae20d7ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4a4620-a83e-43ef-a7be-2eae20d7ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:49 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1404e246-2fe9-4c8d-9b4e-287e5348072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:49 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume 876b31db-3334-4fc2-a1f8-2914d3476c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876b31db-3334-4fc2-a1f8-2914d3476c77', 'volume_size': 1}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Flow 'volume_create_manager' (3682cbe5-f6be-4ad5-98bf-d42ad3147249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acd1134-3001-44ec-a4c7-2ba98c58528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626 1073741824" returned: 0 in 0.707s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acd1134-3001-44ec-a4c7-2ba98c58528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875588100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a16fb71-bc1c-44c4-95dc-c92590de81fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851ba70f8f364f08a59fe34a57e9f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:50Z,use_quota=True,user_id='0d2dd663738b4b8f86454776dcb233f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37013dbe-6bbe-4862-8578-1dd29389fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37013dbe-6bbe-4862-8578-1dd29389fa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b8e0b7-b179-45fe-a0df-cd3708c85c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b8e0b7-b179-45fe-a0df-cd3708c85c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a16fb71-bc1c-44c4-95dc-c92590de81fc', 'volume_name': 'volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6334939f-e617-4e25-acb8-94d65e3a3015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6334939f-e617-4e25-acb8-94d65e3a3015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fddaece-6807-4074-8ad3-ea98cb04b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Volume 5a16fb71-bc1c-44c4-95dc-c92590de81fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc', 'volume_size': 1}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (b772be36-6491-4a37-82da-6af6b273c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7ebc97-270e-4c83-bfcb-c10417b53b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:50 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626
Jul 19 20:03:50 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7ebc97-270e-4c83-bfcb-c10417b53b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58043072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f441cf63-746f-442c-8fa5-0fce8cbdc148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:50Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f650f16-2659-40b1-99aa-4aea299e562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f650f16-2659-40b1-99aa-4aea299e562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80933b2-18cd-4b88-b429-d5e23b62f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80933b2-18cd-4b88-b429-d5e23b62f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f441cf63-746f-442c-8fa5-0fce8cbdc148', 'volume_name': 'volume-f441cf63-746f-442c-8fa5-0fce8cbdc148', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67482105-b786-4ff2-a68f-1966cb561a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67482105-b786-4ff2-a68f-1966cb561a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bb9de4-a762-4629-838f-47ea8725ce0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume f441cf63-746f-442c-8fa5-0fce8cbdc148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f441cf63-746f-442c-8fa5-0fce8cbdc148', 'volume_size': 1}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (3fae48a3-6499-449b-9774-d4da4b35b9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b8cbbd-d56f-4332-8930-903226f47cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b8cbbd-d56f-4332-8930-903226f47cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2008767284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c7a2df-66ba-4548-8f65-ca6006acfd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:51Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56e6e1f-fa32-4a3d-9ea2-77b35b248a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56e6e1f-fa32-4a3d-9ea2-77b35b248a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5c3852-cc9e-4a2b-9f15-73034cd7da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5c3852-cc9e-4a2b-9f15-73034cd7da0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c7a2df-66ba-4548-8f65-ca6006acfd7c', 'volume_name': 'volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce3b507-a812-4de6-bf69-886259c0b777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce3b507-a812-4de6-bf69-886259c0b777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16d05b4-c48b-4229-934b-24efc4c2379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume f4c7a2df-66ba-4548-8f65-ca6006acfd7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c', 'volume_size': 1}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:50 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626" returned: 0 in 0.459s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712090683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876b31db-3334-4fc2-a1f8-2914d3476c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:50Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Creating volume 876b31db-3334-4fc2-a1f8-2914d3476c77 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:50 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dd7988-53dc-4a43-bd73-b183d065bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561486bc-b430-4ee8-8cc9-8228b4cd6d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:50 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77 1073741824
Jul 19 20:03:50 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:50 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626 (adb6efff-80f5-4ae0-b6e0-478c92b1d626): created successfully
Jul 19 20:03:50 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561486bc-b430-4ee8-8cc9-8228b4cd6d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (b09c9ef3-fdba-4d63-bb45-ff7b6348c485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-82dcbf7f-ed5b-40a4-8a8d-b00f86b7be2a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created volume successfully.
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (63a43ad7-c8fd-4a16-8626-7c762ab1dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249a1240-b0b4-43a0-8001-dc0eb4fd9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249a1240-b0b4-43a0-8001-dc0eb4fd9107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-322816399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1997bc23-5f07-4930-ab48-53e0c2277ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:51Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf88632-91a4-473e-b983-71b6fbf54484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf88632-91a4-473e-b983-71b6fbf54484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cbc4de-6b84-44b7-bb1a-d556c0c14169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cbc4de-6b84-44b7-bb1a-d556c0c14169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1997bc23-5f07-4930-ab48-53e0c2277ee2', 'volume_name': 'volume-1997bc23-5f07-4930-ab48-53e0c2277ee2', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5c2839-cb52-4f36-a73a-fd79d1dea96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5c2839-cb52-4f36-a73a-fd79d1dea96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3360aa6d-9127-485c-8c59-d53329562675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:51 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume 1997bc23-5f07-4930-ab48-53e0c2277ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1997bc23-5f07-4930-ab48-53e0c2277ee2', 'volume_size': 1}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:51 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77 1073741824" returned: 0 in 0.562s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:51 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77
Jul 19 20:03:51 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:51 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77" returned: 0 in 0.255s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875588100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a16fb71-bc1c-44c4-95dc-c92590de81fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851ba70f8f364f08a59fe34a57e9f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:50Z,use_quota=True,user_id='0d2dd663738b4b8f86454776dcb233f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Creating volume 5a16fb71-bc1c-44c4-95dc-c92590de81fc {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:51 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1404e246-2fe9-4c8d-9b4e-287e5348072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876b31db-3334-4fc2-a1f8-2914d3476c77', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b017e5d2-c052-459a-a6b2-5501cb3528f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:51 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc 1073741824
Jul 19 20:03:51 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:51 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume volume-876b31db-3334-4fc2-a1f8-2914d3476c77 (876b31db-3334-4fc2-a1f8-2914d3476c77): created successfully
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b017e5d2-c052-459a-a6b2-5501cb3528f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (c8a53273-d050-43b6-903b-d95574b9588d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7c42972f-4155-4ff4-936d-a833a47e2b22 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created volume successfully.
Jul 19 20:03:52 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc 1073741824" returned: 0 in 0.497s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:52 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc
Jul 19 20:03:52 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:52 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc" returned: 0 in 0.251s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-58043072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f441cf63-746f-442c-8fa5-0fce8cbdc148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:50Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Creating volume f441cf63-746f-442c-8fa5-0fce8cbdc148 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:52 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:52 devstack sudo[106127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148 1073741824
Jul 19 20:03:52 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fddaece-6807-4074-8ad3-ea98cb04b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f12c967-ea14-496f-aa56-74d1ace09528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:52 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Volume volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc (5a16fb71-bc1c-44c4-95dc-c92590de81fc): created successfully
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f12c967-ea14-496f-aa56-74d1ace09528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:52 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Flow 'volume_create_manager' (3682cbe5-f6be-4ad5-98bf-d42ad3147249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:52 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e6f8785a-802b-44e3-b402-84875e3a9343 tempest-ProjectReaderTests-78506003 None] Created volume successfully.
Jul 19 20:03:53 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148 1073741824" returned: 0 in 0.444s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:53 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148
Jul 19 20:03:53 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Acquiring lock "cinder-5a16fb71-bc1c-44c4-95dc-c92590de81fc-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Lock "cinder-5a16fb71-bc1c-44c4-95dc-c92590de81fc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Acquiring lock "cinder-quobyte-5a16fb71-bc1c-44c4-95dc-c92590de81fc" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Lock "cinder-quobyte-5a16fb71-bc1c-44c4-95dc-c92590de81fc" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc652b-c15b-4112-8c7e-762e1156c390]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:53 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.569s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2008767284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c7a2df-66ba-4548-8f65-ca6006acfd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:51Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Creating volume f4c7a2df-66ba-4548-8f65-ca6006acfd7c {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:53 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bb9de4-a762-4629-838f-47ea8725ce0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f441cf63-746f-442c-8fa5-0fce8cbdc148', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66c2a32-616c-465a-a1ee-b093a4e0f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:53 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c 1073741824
Jul 19 20:03:53 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:53 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume volume-f441cf63-746f-442c-8fa5-0fce8cbdc148 (f441cf63-746f-442c-8fa5-0fce8cbdc148): created successfully
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66c2a32-616c-465a-a1ee-b093a4e0f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (b772be36-6491-4a37-82da-6af6b273c620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:53 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f885ed33-7cec-4068-8866-b47228d28d39 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created volume successfully.
Jul 19 20:03:53 devstack sudo[106136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc
Jul 19 20:03:53 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:53 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc" returned: 0 in 0.463s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:53 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc
Jul 19 20:03:53 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:53 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c 1073741824" returned: 0 in 0.517s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:53 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c
Jul 19 20:03:53 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:54 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-5a16fb71-bc1c-44c4-95dc-c92590de81fc" returned: 0 in 0.290s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Lock "cinder-quobyte-5a16fb71-bc1c-44c4-95dc-c92590de81fc" released by "delete_volume" :: held 0.805s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Created reservations ['44169bee-3b0f-4a33-89e2-c58d1df640b2', 'b33d0709-152d-41ff-8d47-d444c925af5b', '939fc596-0976-4cec-b3b6-eb9380219662', '78bedad1-a11f-4563-b963-3f80135077b1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:54 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.233s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16d05b4-c48b-4229-934b-24efc4c2379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcf30e8-9864-454f-a5b6-c98ca0fea287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Creating offline snapshot c2aab663-9c84-455d-ac90-7050737585f6 of volume ffd3b824-2c56-4d9c-92a3-87fe68944bcf {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:03:54 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:54 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:54 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c (f4c7a2df-66ba-4548-8f65-ca6006acfd7c): created successfully
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcf30e8-9864-454f-a5b6-c98ca0fea287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (3fae48a3-6499-449b-9774-d4da4b35b9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddb7a93-ba75-4e95-8bdb-6ba8ce955a22]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:54 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8ae7ce04-1ce1-467c-b077-ae70686e02ec tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created volume successfully.
Jul 19 20:03:54 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf
Jul 19 20:03:54 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:54 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.367s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:54 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Deleted volume successfully.
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-25122b11-be5c-4b33-a4a2-e86d88889499 tempest-ProjectReaderTests-78506003 None] Lock "cinder-5a16fb71-bc1c-44c4-95dc-c92590de81fc-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:54 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" returned: 0 in 0.510s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:54 devstack sudo[106162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 1G
Jul 19 20:03:54 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:54 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Flow 'volume_create_manager' (9228616f-a222-4a3f-8746-c8667b69582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a51597-0ded-4381-aee2-cfe0fede93e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a51597-0ded-4381-aee2-cfe0fede93e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720042476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad30f05-55e1-434f-8969-6e5ba4e7d5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851ba70f8f364f08a59fe34a57e9f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:55Z,use_quota=True,user_id='0d2dd663738b4b8f86454776dcb233f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac641ba-5f1f-4e3d-b4a2-57038b43148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac641ba-5f1f-4e3d-b4a2-57038b43148c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585e45a9-f2f1-4586-ad18-abf8b32728f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585e45a9-f2f1-4586-ad18-abf8b32728f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad30f05-55e1-434f-8969-6e5ba4e7d5e2', 'volume_name': 'volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1165deb-1cba-461d-9dac-177b9383d741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1165deb-1cba-461d-9dac-177b9383d741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39400c0d-32f5-4410-bf3c-e6fd2c463ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:55 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Volume fad30f05-55e1-434f-8969-6e5ba4e7d5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2', 'volume_size': 1}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:55 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 1G" returned: 0 in 0.428s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:55 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6
Jul 19 20:03:55 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:55 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6" returned: 0 in 0.308s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:55 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 is being set with open permissions: ugo+rw
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:55 devstack sudo[106174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6
Jul 19 20:03:55 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:55 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6" returned: 0 in 0.308s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:55 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.info
Jul 19 20:03:55 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:56 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.info" returned: 0 in 0.262s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:56 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.info is being set with open permissions: ugo+rw
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:56 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.info
Jul 19 20:03:56 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:56 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.info" returned: 0 in 0.256s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.135s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-322816399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1997bc23-5f07-4930-ab48-53e0c2277ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f30669254a4409b8f4ac0720152eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:51Z,use_quota=True,user_id='b1964dddab494cb7815bb70fa69689be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Creating volume 1997bc23-5f07-4930-ab48-53e0c2277ee2 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:56 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:56 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2 1073741824
Jul 19 20:03:56 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:56 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0703c781-481f-4ad6-b22a-3f93a7fca876 tempest-ProjectReaderTests-1650706838 None] Create snapshot completed successfully
Jul 19 20:03:56 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2 1073741824" returned: 0 in 0.462s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:56 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2
Jul 19 20:03:56 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:57 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2" returned: 0 in 0.270s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720042476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad30f05-55e1-434f-8969-6e5ba4e7d5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851ba70f8f364f08a59fe34a57e9f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:03:55Z,use_quota=True,user_id='0d2dd663738b4b8f86454776dcb233f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Creating volume fad30f05-55e1-434f-8969-6e5ba4e7d5e2 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:03:57 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3360aa6d-9127-485c-8c59-d53329562675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1997bc23-5f07-4930-ab48-53e0c2277ee2', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:57 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2 1073741824
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37640c6-1037-41b9-9396-fe24c77f259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:57 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-c2aab663-9c84-455d-ac90-7050737585f6-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:57 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Volume volume-1997bc23-5f07-4930-ab48-53e0c2277ee2 (1997bc23-5f07-4930-ab48-53e0c2277ee2): created successfully
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37640c6-1037-41b9-9396-fe24c77f259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Flow 'volume_create_manager' (63a43ad7-c8fd-4a16-8626-7c762ab1dc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Lock "cinder-c2aab663-9c84-455d-ac90-7050737585f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:57 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f9a0b83f-bec0-4516-920f-cf717f126507 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created volume successfully.
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-c2aab663-9c84-455d-ac90-7050737585f6" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-c2aab663-9c84-455d-ac90-7050737585f6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Deleting offline snapshot c2aab663-9c84-455d-ac90-7050737585f6 of volume ffd3b824-2c56-4d9c-92a3-87fe68944bcf {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] snapshot_file for this snap is: volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54e840e-6ff2-4174-aaa5-20af5a2cf470]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:57 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6
Jul 19 20:03:57 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:57 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2 1073741824" returned: 0 in 0.533s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=251,cinder:SELECT=175,cinder:INSERT=74,cinder:DELETE=27 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:57 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6" returned: 0 in 0.439s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:03:57 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2
Jul 19 20:03:57 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d06029d-c0c0-4b46-ae51-0fe3e09b8083]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-1997bc23-5f07-4930-ab48-53e0c2277ee2-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-1997bc23-5f07-4930-ab48-53e0c2277ee2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:57 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=190,cinder:UPDATE=240,cinder:DELETE=20,cinder:INSERT=58 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-quobyte-1997bc23-5f07-4930-ab48-53e0c2277ee2" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-1997bc23-5f07-4930-ab48-53e0c2277ee2" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a003aa-c156-4f6a-8c0f-4b100dd8bfe7]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:58 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:58 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:58 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2" returned: 0 in 0.338s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39400c0d-32f5-4410-bf3c-e6fd2c463ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b4b17e-c19d-4b5a-9e9c-3d990b1d76d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:03:58 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Volume volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2 (fad30f05-55e1-434f-8969-6e5ba4e7d5e2): created successfully
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b4b17e-c19d-4b5a-9e9c-3d990b1d76d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Flow 'volume_create_manager' (9228616f-a222-4a3f-8746-c8667b69582a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:03:58 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d93bc9a4-66da-47b9-bf74-7047b275e3cb tempest-ProjectReaderTests-78506003 None] Created volume successfully.
Jul 19 20:03:58 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2
Jul 19 20:03:58 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:58 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" returned: 0 in 0.570s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:58 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6
Jul 19 20:03:58 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:58 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2" returned: 0 in 0.450s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:58 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2
Jul 19 20:03:58 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:58 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6" returned: 0 in 0.360s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:58 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1997bc23-5f07-4930-ab48-53e0c2277ee2" returned: 0 in 0.262s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-1997bc23-5f07-4930-ab48-53e0c2277ee2" released by "delete_volume" :: held 0.769s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:58 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6
Jul 19 20:03:58 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created reservations ['786eff7d-0a95-477f-9d6e-d1a3d61efa4e', 'f17b4c3c-8f32-45d2-9856-b9590c6ea923', 'ee9225c7-c5e0-446e-9753-73827104e9cc', 'e2caa463-f2c3-419d-9868-1399a9e97c17'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:03:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:58 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:03:58 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:59 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf.c2aab663-9c84-455d-ac90-7050737585f6" returned: 0 in 0.273s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-f4c7a2df-66ba-4548-8f65-ca6006acfd7c-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-c2aab663-9c84-455d-ac90-7050737585f6" released by "_delete_snapshot" :: held 1.794s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" released by "delete_snapshot" :: held 1.830s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-f4c7a2df-66ba-4548-8f65-ca6006acfd7c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-quobyte-f4c7a2df-66ba-4548-8f65-ca6006acfd7c" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:59 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.282s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:03:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Deleted volume successfully.
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-f4c7a2df-66ba-4548-8f65-ca6006acfd7c" acquired by "delete_volume" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Created reservations ['ad632d76-03b7-41ec-b293-d618ec701407', 'fe0f0004-1e60-4e73-9d81-b50cd59ebe02', '8a00825d-895b-4647-a765-ce63d51ec859', 'c1747a8b-2dea-4457-af9b-280168a16917'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-18a6e12b-341b-4f64-b91b-d65293333c7a tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-1997bc23-5f07-4930-ab48-53e0c2277ee2-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d18295c-d1a7-4029-8df3-8e0f27cf0dda]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Acquiring lock "cinder-fad30f05-55e1-434f-8969-6e5ba4e7d5e2-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Lock "cinder-fad30f05-55e1-434f-8969-6e5ba4e7d5e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Delete snapshot completed successfully.
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Acquiring lock "cinder-quobyte-fad30f05-55e1-434f-8969-6e5ba4e7d5e2" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6772f25a-961b-4028-97dc-111bbf8fb29f tempest-ProjectReaderTests-1650706838 None] Lock "cinder-c2aab663-9c84-455d-ac90-7050737585f6-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Lock "cinder-quobyte-fad30f05-55e1-434f-8969-6e5ba4e7d5e2" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:59 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c
Jul 19 20:03:59 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fda7042-deaf-4762-8195-2d772ec392f3]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-ffd3b824-2c56-4d9c-92a3-87fe68944bcf-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Lock "cinder-ffd3b824-2c56-4d9c-92a3-87fe68944bcf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:59 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2
Jul 19 20:03:59 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" acquired by "delete_volume" :: waited 0.033s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[1304a047-b8eb-4830-ba8a-1bacd73d7227]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:59 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c" returned: 0 in 0.587s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:03:59 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf
Jul 19 20:03:59 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:59 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c
Jul 19 20:03:59 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:03:59 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2" returned: 0 in 0.468s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:03:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:00 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2
Jul 19 20:04:00 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:00 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" returned: 0 in 0.462s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:00 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c7a2df-66ba-4548-8f65-ca6006acfd7c" returned: 0 in 0.338s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:00 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-fad30f05-55e1-434f-8969-6e5ba4e7d5e2" returned: 0 in 0.294s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:00 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf
Jul 19 20:04:00 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-f4c7a2df-66ba-4548-8f65-ca6006acfd7c" released by "delete_volume" :: held 1.010s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Lock "cinder-quobyte-fad30f05-55e1-434f-8969-6e5ba4e7d5e2" released by "delete_volume" :: held 0.831s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Created reservations ['f748c438-334b-4919-82ec-e90615751176', 'fae1b24f-0bd4-4ece-9ead-fe98bbd58924', '070b32fc-5114-4c3f-b336-b3e97bbb5482', 'ac3303dd-9917-49d5-9b49-61229668c354'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created reservations ['2f1c1ae7-7274-4746-bb98-a0024b896739', 'd3a578a9-a277-4529-9373-add61a784ca0', '93fb288b-4b14-43dc-ab30-70bd90d3e1dc', '9bfcafdb-3fee-485c-bde6-4da95e57084c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:00 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:00 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:00 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:00 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:00 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" returned: 0 in 0.389s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-ffd3b824-2c56-4d9c-92a3-87fe68944bcf" released by "delete_volume" :: held 0.936s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Created reservations ['a9a0d672-63f0-4f4d-baa8-f581281e7876', 'b9258fcf-286f-40d1-b439-67fc1825d594', '0346d60c-34fd-48f3-8fee-41a45fed3cf3', '09885fc1-2cc8-49e9-b3ea-1ccea175b51c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:00 devstack sudo[106262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:00 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:00 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.367s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Deleted volume successfully.
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1d973835-ed8b-4208-a765-ec9e41a1e637 tempest-ProjectReaderTests-78506003 None] Lock "cinder-fad30f05-55e1-434f-8969-6e5ba4e7d5e2-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:00 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.386s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:00 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Deleted volume successfully.
Jul 19 20:04:00 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1ebda09d-396e-4e8a-a158-2e28b36879d7 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-f4c7a2df-66ba-4548-8f65-ca6006acfd7c-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:01 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.295s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:01 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Deleted volume successfully.
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-232cb23f-1421-4323-b945-3425b07a48ae tempest-ProjectReaderTests-1650706838 None] Lock "cinder-ffd3b824-2c56-4d9c-92a3-87fe68944bcf-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Flow 'volume_create_manager' (768e58cc-30df-4d3e-9f23-88c9346a364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7b8aae-ef7f-42d7-ac69-443b268b00c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7b8aae-ef7f-42d7-ac69-443b268b00c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938082435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a49af0-9345-455f-a49f-d51c927aaba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851ba70f8f364f08a59fe34a57e9f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:01Z,use_quota=True,user_id='0d2dd663738b4b8f86454776dcb233f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bd1f2e-4822-49c2-acb2-ac666d1a5fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bd1f2e-4822-49c2-acb2-ac666d1a5fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877f83c0-6102-42fd-afb6-09f6f8b0cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877f83c0-6102-42fd-afb6-09f6f8b0cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a49af0-9345-455f-a49f-d51c927aaba9', 'volume_name': 'volume-55a49af0-9345-455f-a49f-d51c927aaba9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b4fc44-d3a5-4d53-bfc2-9c5fc810fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b4fc44-d3a5-4d53-bfc2-9c5fc810fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d893b65-aa9c-4a77-82dd-0b11f52e74df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:01 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Volume 55a49af0-9345-455f-a49f-d51c927aaba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a49af0-9345-455f-a49f-d51c927aaba9', 'volume_size': 1}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938082435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a49af0-9345-455f-a49f-d51c927aaba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851ba70f8f364f08a59fe34a57e9f5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:01Z,use_quota=True,user_id='0d2dd663738b4b8f86454776dcb233f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Creating volume 55a49af0-9345-455f-a49f-d51c927aaba9 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:01 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:01 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9 1073741824
Jul 19 20:04:01 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-f441cf63-746f-442c-8fa5-0fce8cbdc148-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-f441cf63-746f-442c-8fa5-0fce8cbdc148-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-quobyte-f441cf63-746f-442c-8fa5-0fce8cbdc148" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-f441cf63-746f-442c-8fa5-0fce8cbdc148" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d3e94-df70-4f97-89fb-270d2a57795d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:01 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148
Jul 19 20:04:01 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:01 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9 1073741824" returned: 0 in 0.481s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:01 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9
Jul 19 20:04:01 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:01 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148" returned: 0 in 0.420s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:01 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148
Jul 19 20:04:01 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:02 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9" returned: 0 in 0.299s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d893b65-aa9c-4a77-82dd-0b11f52e74df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a49af0-9345-455f-a49f-d51c927aaba9', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404698e5-1501-4859-92a1-2dbc50f532b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Volume volume-55a49af0-9345-455f-a49f-d51c927aaba9 (55a49af0-9345-455f-a49f-d51c927aaba9): created successfully
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404698e5-1501-4859-92a1-2dbc50f532b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Flow 'volume_create_manager' (768e58cc-30df-4d3e-9f23-88c9346a364e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f9f9d6d8-fcdd-4716-befc-0cc425cef55d tempest-ProjectReaderTests-78506003 None] Created volume successfully.
Jul 19 20:04:02 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f441cf63-746f-442c-8fa5-0fce8cbdc148" returned: 0 in 0.312s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-f441cf63-746f-442c-8fa5-0fce8cbdc148" released by "delete_volume" :: held 0.778s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created reservations ['313abdfe-a158-4168-b251-18e557ca457b', 'ef207317-87ab-48e9-880f-fdfc0312023b', '3cb5f124-9be7-48f0-a597-8d8e2a8fb393', '66fd4aa6-9412-45b3-9cd2-2c8cbfb2c67e'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Acquiring lock "cinder-55a49af0-9345-455f-a49f-d51c927aaba9-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Lock "cinder-55a49af0-9345-455f-a49f-d51c927aaba9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (85efbf4b-8ec6-4ebb-9762-6637543fc99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5036590e-a1c8-4b0d-94d9-171e536d3327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-876b31db-3334-4fc2-a1f8-2914d3476c77-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5036590e-a1c8-4b0d-94d9-171e536d3327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739908693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51f9727-c80e-4b1e-a5b0-225b0b005c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:02Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bbccaf-44a4-4dfd-8f98-0bcb8678b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bbccaf-44a4-4dfd-8f98-0bcb8678b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:02 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc18760-173f-4528-ae55-c50b7c7a5822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:02 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc18760-173f-4528-ae55-c50b7c7a5822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51f9727-c80e-4b1e-a5b0-225b0b005c11', 'volume_name': 'volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2716aeb7-daa2-45e8-b655-7f7484065982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2716aeb7-daa2-45e8-b655-7f7484065982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b8a31e-4442-4cfa-8891-27a8d3c0c7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:02 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Volume c51f9727-c80e-4b1e-a5b0-225b0b005c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11', 'volume_size': 1}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739908693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51f9727-c80e-4b1e-a5b0-225b0b005c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:02Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Creating volume c51f9727-c80e-4b1e-a5b0-225b0b005c11 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:02 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Acquiring lock "cinder-quobyte-55a49af0-9345-455f-a49f-d51c927aaba9" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-876b31db-3334-4fc2-a1f8-2914d3476c77-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:02 devstack sudo[106285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 1073741824
Jul 19 20:04:02 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Lock "cinder-quobyte-55a49af0-9345-455f-a49f-d51c927aaba9" acquired by "delete_volume" :: waited 0.042s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[902eeaff-58f6-4364-91cd-aa4d599abecf]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-quobyte-876b31db-3334-4fc2-a1f8-2914d3476c77" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-876b31db-3334-4fc2-a1f8-2914d3476c77" acquired by "delete_volume" :: waited 0.023s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc5b0e-539b-42c6-b055-bd3378d5b8b0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:02 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9
Jul 19 20:04:02 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:02 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.322s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:02 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Deleted volume successfully.
Jul 19 20:04:02 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-930fbffa-4f33-4e18-8039-1cb3a5a47964 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-f441cf63-746f-442c-8fa5-0fce8cbdc148-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:02 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77
Jul 19 20:04:02 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:03 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9" returned: 0 in 0.420s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:03 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 1073741824" returned: 0 in 0.531s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:03 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9
Jul 19 20:04:03 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:03 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11
Jul 19 20:04:03 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:03 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77" returned: 0 in 0.441s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:03 devstack sudo[106307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77
Jul 19 20:04:03 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:03 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-55a49af0-9345-455f-a49f-d51c927aaba9" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Lock "cinder-quobyte-55a49af0-9345-455f-a49f-d51c927aaba9" released by "delete_volume" :: held 0.757s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:03 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11" returned: 0 in 0.298s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b8a31e-4442-4cfa-8891-27a8d3c0c7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a053d468-ec3e-46d7-83c0-64836d156dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Created reservations ['2baff1a8-e23d-4117-96ec-3e4b3435cf47', '6c5daf95-fc49-4776-934c-28ea429aeecd', '1701181b-0cbf-49a2-b57e-8b0f7efa9548', '1b04e981-f7a4-41bd-bf2d-91829c2c81da'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:03 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Volume volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 (c51f9727-c80e-4b1e-a5b0-225b0b005c11): created successfully
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a053d468-ec3e-46d7-83c0-64836d156dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (85efbf4b-8ec6-4ebb-9762-6637543fc99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:03 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-876b31db-3334-4fc2-a1f8-2914d3476c77" returned: 0 in 0.330s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ba19439f-4358-4d3d-a40e-64279eaf9a2a tempest-ProjectReaderTests-1650706838 None] Created volume successfully.
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-876b31db-3334-4fc2-a1f8-2914d3476c77" released by "delete_volume" :: held 0.824s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created reservations ['9f3312d2-c64a-4ca7-bfa4-4a34d692c2d8', '0219307b-4b26-4ca3-83d9-1f4f9e55683d', 'f0e08b5f-2801-4e28-91c1-19b19a3dd5b7', 'a5f41532-568f-4db6-8edd-c6ba8f0a75d6'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:03 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:03 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:03 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:03 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:03 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.277s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:03 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Deleted volume successfully.
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-aaa727e8-82c5-4e83-9aaa-7411c6a26bbc tempest-ProjectReaderTests-78506003 None] Lock "cinder-55a49af0-9345-455f-a49f-d51c927aaba9-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:04 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:04 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Deleted volume successfully.
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-8254b4e4-e0dc-461a-b818-817ad108ff42 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-876b31db-3334-4fc2-a1f8-2914d3476c77-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Creating offline snapshot 5eb38b2b-4f86-4037-8df6-b42507fec749 of volume c51f9727-c80e-4b1e-a5b0-225b0b005c11 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ef91b-d65e-4a00-8c5b-1d33a98793c6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-adb6efff-80f5-4ae0-b6e0-478c92b1d626-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-adb6efff-80f5-4ae0-b6e0-478c92b1d626-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:04 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11
Jul 19 20:04:04 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-quobyte-adb6efff-80f5-4ae0-b6e0-478c92b1d626" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-adb6efff-80f5-4ae0-b6e0-478c92b1d626" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b206f6f-9943-49c5-957b-e6dc4f50bafc]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:05 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626
Jul 19 20:04:05 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:05 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11" returned: 0 in 0.468s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:05 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 1G
Jul 19 20:04:05 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:05 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626" returned: 0 in 0.448s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:05 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626
Jul 19 20:04:05 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:05 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 1G" returned: 0 in 0.568s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:05 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-adb6efff-80f5-4ae0-b6e0-478c92b1d626" returned: 0 in 0.379s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:05 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749
Jul 19 20:04:05 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-adb6efff-80f5-4ae0-b6e0-478c92b1d626" released by "delete_volume" :: held 0.929s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:05 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created reservations ['bc76a5c3-018f-417c-8a7f-5b0cf028ea3d', '576209e1-db0a-4c93-838b-d0b655e89f32', '1766ac5d-0221-476f-be21-cbff492be3ec', '9cbb0895-46d5-4db0-b376-d81868403636'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:06 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:06 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-baaac6e9-26a7-4077-a0c6-65afe5ad8f02-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-baaac6e9-26a7-4077-a0c6-65afe5ad8f02-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "cinder-quobyte-baaac6e9-26a7-4077-a0c6-65afe5ad8f02" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-baaac6e9-26a7-4077-a0c6-65afe5ad8f02" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:06 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749" returned: 0 in 0.494s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:06 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 is being set with open permissions: ugo+rw
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c4f4d8-850f-4e87-8b24-62fb2ea5e33a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:06 devstack sudo[106345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749
Jul 19 20:04:06 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:06 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.396s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:06 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Deleted volume successfully.
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0e06f363-1517-484f-bcea-564146fd6ec9 tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-adb6efff-80f5-4ae0-b6e0-478c92b1d626-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:06 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02
Jul 19 20:04:06 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:06 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749" returned: 0 in 0.366s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:06 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.info
Jul 19 20:04:06 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:06 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02" returned: 0 in 0.585s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:06 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02
Jul 19 20:04:06 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:06 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.info" returned: 0 in 0.342s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:06 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.info is being set with open permissions: ugo+rw
Jul 19 20:04:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:07 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.info
Jul 19 20:04:07 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:07 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-baaac6e9-26a7-4077-a0c6-65afe5ad8f02" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-quobyte-baaac6e9-26a7-4077-a0c6-65afe5ad8f02" released by "delete_volume" :: held 0.965s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Created reservations ['85c01588-5e88-4c1d-b748-261208b8b8f0', 'b7644d3d-6b89-47b1-b312-17686466187d', '5940c79c-a99f-4f8d-ab99-262848e6b810', 'b36b4895-6bc7-49f5-a4f7-fb3ac85dcbe1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:07 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.info" returned: 0 in 0.292s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:07 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-691036d7-19f9-478f-8d8b-b0d7696ea108 tempest-ProjectReaderTests-1650706838 None] Create snapshot completed successfully
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:07 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:07 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:07 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:07 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Deleted volume successfully.
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-d8934a5e-3e00-4523-aa81-13bf1f66664b tempest-CreateVolumesFromSourceVolumeTest-78935927 None] Lock "cinder-baaac6e9-26a7-4077-a0c6-65afe5ad8f02-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-5eb38b2b-4f86-4037-8df6-b42507fec749-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Lock "cinder-5eb38b2b-4f86-4037-8df6-b42507fec749-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-c51f9727-c80e-4b1e-a5b0-225b0b005c11" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-c51f9727-c80e-4b1e-a5b0-225b0b005c11" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-5eb38b2b-4f86-4037-8df6-b42507fec749" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-5eb38b2b-4f86-4037-8df6-b42507fec749" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Deleting offline snapshot 5eb38b2b-4f86-4037-8df6-b42507fec749 of volume c51f9727-c80e-4b1e-a5b0-225b0b005c11 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:04:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] snapshot_file for this snap is: volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:04:08 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[2779a406-6769-4285-84c2-fc154b88e94a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:08 devstack sudo[106366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749
Jul 19 20:04:08 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:08 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749" returned: 0 in 0.505s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:04:08 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd566dc0-a1f7-4c74-b044-ba448f978b1f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:08 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11
Jul 19 20:04:08 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:09 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11" returned: 0 in 0.449s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:09 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749
Jul 19 20:04:09 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:09 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749" returned: 0 in 0.441s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:09 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749
Jul 19 20:04:09 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:09 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11.5eb38b2b-4f86-4037-8df6-b42507fec749" returned: 0 in 0.374s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-5eb38b2b-4f86-4037-8df6-b42507fec749" released by "_delete_snapshot" :: held 1.904s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:09 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-c51f9727-c80e-4b1e-a5b0-225b0b005c11" released by "delete_snapshot" :: held 1.936s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Created reservations ['c334bd25-4bed-45ea-8b73-6edf4ba152a3', 'a1ba14b4-bc00-40fe-9b8e-3af1dd36db3a', '5d1e8163-2800-4363-bd64-749f3e3ef169', '7f229757-5aee-4a6e-a29f-405ab96a6161'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Delete snapshot completed successfully.
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-1a14ebdc-6cb7-4761-89aa-a10b22c8bfbb tempest-ProjectReaderTests-1650706838 None] Lock "cinder-5eb38b2b-4f86-4037-8df6-b42507fec749-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-c51f9727-c80e-4b1e-a5b0-225b0b005c11-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-c51f9727-c80e-4b1e-a5b0-225b0b005c11-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-c51f9727-c80e-4b1e-a5b0-225b0b005c11" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-c51f9727-c80e-4b1e-a5b0-225b0b005c11" acquired by "delete_volume" :: waited 0.026s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9d469f-2c38-48a6-a972-2cdf7743a348]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:10 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11
Jul 19 20:04:10 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:10 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11" returned: 0 in 0.479s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:10 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11
Jul 19 20:04:10 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:11 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c51f9727-c80e-4b1e-a5b0-225b0b005c11" returned: 0 in 0.305s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-c51f9727-c80e-4b1e-a5b0-225b0b005c11" released by "delete_volume" :: held 0.867s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Created reservations ['1c3c116b-4318-4011-8ec4-7b84ed594794', 'ecb717f9-e1cc-4a1c-87c0-8a1d13fc0d9d', 'eef4940b-68dc-4577-86dc-cbd18efa5acf', '996aeeda-f615-4f02-b2c7-31b97ebd775f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:11 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:11 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:11 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:11 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Deleted volume successfully.
Jul 19 20:04:11 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-131ec53b-ccbc-4f01-93c9-505066d53c91 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-c51f9727-c80e-4b1e-a5b0-225b0b005c11-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (f39caaf8-ac7f-498a-98c9-bea9269c09ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e53cbb-9e4a-4499-9252-65ea209a22d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e53cbb-9e4a-4499-9252-65ea209a22d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-621807481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e58c171-18b5-47dc-abad-182d719c98d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:12Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870200a1-b9a0-47e5-b8e2-e781a56a463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870200a1-b9a0-47e5-b8e2-e781a56a463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe6d104-586f-4a3a-8361-a782bc4d9d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe6d104-586f-4a3a-8361-a782bc4d9d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e58c171-18b5-47dc-abad-182d719c98d6', 'volume_name': 'volume-9e58c171-18b5-47dc-abad-182d719c98d6', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ad63e1-e052-4677-85ed-fc4e9f0dbce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ad63e1-e052-4677-85ed-fc4e9f0dbce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b7c5fc-1fd3-4902-b680-f3462e2f5b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Volume 9e58c171-18b5-47dc-abad-182d719c98d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e58c171-18b5-47dc-abad-182d719c98d6', 'volume_size': 1}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-621807481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e58c171-18b5-47dc-abad-182d719c98d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:12Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Creating volume 9e58c171-18b5-47dc-abad-182d719c98d6 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:12 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:12 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6 1073741824
Jul 19 20:04:12 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Flow 'volume_create_manager' (50d0784a-272d-44da-a817-303250394268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbcabff-4192-4aa4-85dc-5d1444ea9459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbcabff-4192-4aa4-85dc-5d1444ea9459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5fa921-d4c2-48a0-9beb-e5328a1b8781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd1d5ce48454c48a66ea31f45b93ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:12Z,use_quota=True,user_id='24b4bbb4771043548dc254017433baed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da4561c-ed4d-4062-82d5-2b19c0bf9ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da4561c-ed4d-4062-82d5-2b19c0bf9ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dcd8cf6-d7b0-4015-9329-456b3a83fe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dcd8cf6-d7b0-4015-9329-456b3a83fe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5fa921-d4c2-48a0-9beb-e5328a1b8781', 'volume_name': 'volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f280112-1e7d-4bc2-b12a-2eba38d3612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f280112-1e7d-4bc2-b12a-2eba38d3612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd76c92-7dd0-46d8-94cd-ed5ad63eb883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:12 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Volume 1e5fa921-d4c2-48a0-9beb-e5328a1b8781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781', 'volume_size': 1}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:12 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6 1073741824" returned: 0 in 0.652s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:12 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6
Jul 19 20:04:12 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:13 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.787s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5fa921-d4c2-48a0-9beb-e5328a1b8781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd1d5ce48454c48a66ea31f45b93ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:12Z,use_quota=True,user_id='24b4bbb4771043548dc254017433baed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Creating volume 1e5fa921-d4c2-48a0-9beb-e5328a1b8781 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:13 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b7c5fc-1fd3-4902-b680-f3462e2f5b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e58c171-18b5-47dc-abad-182d719c98d6', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88a8b17-68c9-4c89-bd70-c95e4101e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:13 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781 1073741824
Jul 19 20:04:13 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:13 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Volume volume-9e58c171-18b5-47dc-abad-182d719c98d6 (9e58c171-18b5-47dc-abad-182d719c98d6): created successfully
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88a8b17-68c9-4c89-bd70-c95e4101e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (f39caaf8-ac7f-498a-98c9-bea9269c09ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-17de71f1-9145-45db-a8c5-25c4975e9f3f tempest-ProjectReaderTests-1650706838 None] Created volume successfully.
Jul 19 20:04:13 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781 1073741824" returned: 0 in 0.524s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:13 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781
Jul 19 20:04:13 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:14 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781" returned: 0 in 0.283s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd76c92-7dd0-46d8-94cd-ed5ad63eb883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ba274d-f6e2-4cd5-a232-b2af2ad751b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:14 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Volume volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781 (1e5fa921-d4c2-48a0-9beb-e5328a1b8781): created successfully
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ba274d-f6e2-4cd5-a232-b2af2ad751b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Flow 'volume_create_manager' (50d0784a-272d-44da-a817-303250394268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:14 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-62684ecb-de21-4a70-bee8-ad065c9236ce tempest-CinderUnicodeTest-874679568 None] Created volume successfully.
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Creating offline snapshot 4cfca2d3-1f32-470a-9e41-7ae3b64f5465 of volume 9e58c171-18b5-47dc-abad-182d719c98d6 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1176f5-519f-4c14-92a3-f16c0eba3767]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:14 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6
Jul 19 20:04:14 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:15 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6" returned: 0 in 0.555s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:15 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 1G
Jul 19 20:04:15 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Flow 'volume_create_manager' (fd4412c5-a9f7-4e0c-b177-6d4935020cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a55489f-d28f-495f-8d1f-0912e03dcdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a55489f-d28f-495f-8d1f-0912e03dcdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1890517153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c53534-c2df-4fe6-ad56-b40703bb1313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd1d5ce48454c48a66ea31f45b93ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:15Z,use_quota=True,user_id='24b4bbb4771043548dc254017433baed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495fadcb-7c47-48ce-b7fe-a77e8de0c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495fadcb-7c47-48ce-b7fe-a77e8de0c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd67847-24df-4fc9-9575-b62eb7c34d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd67847-24df-4fc9-9575-b62eb7c34d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c53534-c2df-4fe6-ad56-b40703bb1313', 'volume_name': 'volume-56c53534-c2df-4fe6-ad56-b40703bb1313', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ed99f0-99b2-44de-9f2f-46938cb8d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ed99f0-99b2-44de-9f2f-46938cb8d64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8248790-a8c5-4de6-82b7-07c1fd79a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:15 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Volume 56c53534-c2df-4fe6-ad56-b40703bb1313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c53534-c2df-4fe6-ad56-b40703bb1313', 'volume_size': 1}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:15 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 1G" returned: 0 in 0.569s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e58c171-18b5-47dc-abad-182d719c98d6 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:15 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e58c171-18b5-47dc-abad-182d719c98d6 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465
Jul 19 20:04:15 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:15 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e58c171-18b5-47dc-abad-182d719c98d6 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465" returned: 0 in 0.390s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:15 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 is being set with open permissions: ugo+rw
Jul 19 20:04:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:16 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465
Jul 19 20:04:16 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:16 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465" returned: 0 in 0.327s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:16 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.info
Jul 19 20:04:16 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:16 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.info" returned: 0 in 0.437s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:16 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.info is being set with open permissions: ugo+rw
Jul 19 20:04:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:16 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.info
Jul 19 20:04:16 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:17 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.info" returned: 0 in 0.326s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1890517153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c53534-c2df-4fe6-ad56-b40703bb1313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd1d5ce48454c48a66ea31f45b93ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:15Z,use_quota=True,user_id='24b4bbb4771043548dc254017433baed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Creating volume 56c53534-c2df-4fe6-ad56-b40703bb1313 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:17 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:17 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313 1073741824
Jul 19 20:04:17 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3a2d80fa-bab2-4dfa-8a20-55cbce89ab12 tempest-ProjectReaderTests-1650706838 None] Create snapshot completed successfully
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-4cfca2d3-1f32-470a-9e41-7ae3b64f5465-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-4cfca2d3-1f32-470a-9e41-7ae3b64f5465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-9e58c171-18b5-47dc-abad-182d719c98d6" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-9e58c171-18b5-47dc-abad-182d719c98d6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-4cfca2d3-1f32-470a-9e41-7ae3b64f5465" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-4cfca2d3-1f32-470a-9e41-7ae3b64f5465" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Deleting offline snapshot 4cfca2d3-1f32-470a-9e41-7ae3b64f5465 of volume 9e58c171-18b5-47dc-abad-182d719c98d6 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] snapshot_file for this snap is: volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6674bc6-1845-4c7b-8b05-6dd36d22b2b6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:17 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313 1073741824" returned: 0 in 0.644s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:17 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313
Jul 19 20:04:17 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:17 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465
Jul 19 20:04:17 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:18 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313" returned: 0 in 0.480s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:18 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465" returned: 0 in 0.570s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e58c171-18b5-47dc-abad-182d719c98d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8248790-a8c5-4de6-82b7-07c1fd79a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c53534-c2df-4fe6-ad56-b40703bb1313', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b5911b-c09d-4336-873d-5bfecc39db7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79bc5c4-f4bc-4858-a56e-e0242c953d7b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:18 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Volume volume-56c53534-c2df-4fe6-ad56-b40703bb1313 (56c53534-c2df-4fe6-ad56-b40703bb1313): created successfully
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b5911b-c09d-4336-873d-5bfecc39db7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:18 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Flow 'volume_create_manager' (fd4412c5-a9f7-4e0c-b177-6d4935020cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:18 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2275b153-4ef6-4cbe-a11e-afdac2c500aa tempest-CinderUnicodeTest-874679568 None] Created volume successfully.
Jul 19 20:04:18 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6
Jul 19 20:04:18 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:19 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6" returned: 0 in 0.559s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:19 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465
Jul 19 20:04:19 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:19 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465" returned: 0 in 0.507s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:19 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465
Jul 19 20:04:19 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Creating offline snapshot c6e54ef7-c8c9-4974-aa11-6129174de1d5 of volume 56c53534-c2df-4fe6-ad56-b40703bb1313 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ce00aa-3cf0-4403-9b72-46c355fdfbcf]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:19 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6.4cfca2d3-1f32-470a-9e41-7ae3b64f5465" returned: 0 in 0.353s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-4cfca2d3-1f32-470a-9e41-7ae3b64f5465" released by "_delete_snapshot" :: held 2.164s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-9e58c171-18b5-47dc-abad-182d719c98d6" released by "delete_snapshot" :: held 2.201s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:19 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313
Jul 19 20:04:19 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:20 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Created reservations ['3ce2b860-fed9-40c5-be4d-d5c3c7ec8f59', 'e9bbe6c8-f943-4783-8bcb-61893be8c470', '1f7b2da3-2034-47f2-a0d2-7575b9398984', 'db4cfafb-22a0-424f-90e8-78201544a631'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:20 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Delete snapshot completed successfully.
Jul 19 20:04:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c44d0a8e-89b5-425d-9e53-b340b42aa742 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-4cfca2d3-1f32-470a-9e41-7ae3b64f5465-delete_snapshot" released by "delete_snapshot" :: held 2.373s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:20 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313" returned: 0 in 0.435s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:20 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 1G
Jul 19 20:04:20 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:20 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 1G" returned: 0 in 0.538s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c53534-c2df-4fe6-ad56-b40703bb1313 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:20 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c53534-c2df-4fe6-ad56-b40703bb1313 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5
Jul 19 20:04:20 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-9e58c171-18b5-47dc-abad-182d719c98d6-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Lock "cinder-9e58c171-18b5-47dc-abad-182d719c98d6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-9e58c171-18b5-47dc-abad-182d719c98d6" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-9e58c171-18b5-47dc-abad-182d719c98d6" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50b8243-3627-42db-b244-ccd27de2f912]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:21 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c53534-c2df-4fe6-ad56-b40703bb1313 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5" returned: 0 in 0.409s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:21 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 is being set with open permissions: ugo+rw
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:21 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5
Jul 19 20:04:21 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:21 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6
Jul 19 20:04:21 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:21 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5" returned: 0 in 0.318s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:21 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.info
Jul 19 20:04:21 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:21 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6" returned: 0 in 0.492s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:21 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6
Jul 19 20:04:21 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:21 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.info" returned: 0 in 0.322s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:21 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.info is being set with open permissions: ugo+rw
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:21 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9e58c171-18b5-47dc-abad-182d719c98d6" returned: 0 in 0.313s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:21 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.info
Jul 19 20:04:21 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:21 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-9e58c171-18b5-47dc-abad-182d719c98d6" released by "delete_volume" :: held 0.899s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Created reservations ['f6038f71-c45c-4fb3-98d2-9bf2473a7b02', 'dfd0949a-ed18-4466-a107-1b00440fad7b', '45380477-bea9-40a9-aff7-e03ae7ec660d', 'c9b98ca6-cf7f-4c4c-955b-eba93a5f18f4'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:22 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:22 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:22 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.info" returned: 0 in 0.358s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-dad70db4-26f6-4225-9fed-60707e49eeb6 tempest-CinderUnicodeTest-874679568 None] Create snapshot completed successfully
Jul 19 20:04:22 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.317s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Deleted volume successfully.
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2e92ab95-d63d-4254-830c-869b102a86ac tempest-ProjectReaderTests-1650706838 None] Lock "cinder-9e58c171-18b5-47dc-abad-182d719c98d6-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (5d57e8b6-73d2-4d96-94d3-8ec2511d1dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d6dacb-cefa-4518-a298-7901be37e81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d6dacb-cefa-4518-a298-7901be37e81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988674554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b59327c-d247-4962-9ba4-2b982910e51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:23Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a5cf69-b2cd-4dc8-bbee-dd9e608f9fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a5cf69-b2cd-4dc8-bbee-dd9e608f9fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4f6178-3eee-4b04-a12d-f30b2c44a6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4f6178-3eee-4b04-a12d-f30b2c44a6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b59327c-d247-4962-9ba4-2b982910e51f', 'volume_name': 'volume-9b59327c-d247-4962-9ba4-2b982910e51f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edf5fd1-e83c-40f5-823f-13fe748712dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edf5fd1-e83c-40f5-823f-13fe748712dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ac82c7-a991-467a-b585-9a0602fe7af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:22 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Volume 9b59327c-d247-4962-9ba4-2b982910e51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b59327c-d247-4962-9ba4-2b982910e51f', 'volume_size': 1}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988674554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b59327c-d247-4962-9ba4-2b982910e51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b032bdc2874b9ca87a884e18518244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:23Z,use_quota=True,user_id='3e297641b49e4036a30e809db8f98ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Creating volume 9b59327c-d247-4962-9ba4-2b982910e51f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:22 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:23 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f 1073741824
Jul 19 20:04:23 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Acquiring lock "cinder-c6e54ef7-c8c9-4974-aa11-6129174de1d5-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Lock "cinder-c6e54ef7-c8c9-4974-aa11-6129174de1d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Acquiring lock "cinder-quobyte-56c53534-c2df-4fe6-ad56-b40703bb1313" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Lock "cinder-quobyte-56c53534-c2df-4fe6-ad56-b40703bb1313" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Acquiring lock "cinder-quobyte-c6e54ef7-c8c9-4974-aa11-6129174de1d5" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Lock "cinder-quobyte-c6e54ef7-c8c9-4974-aa11-6129174de1d5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Deleting offline snapshot c6e54ef7-c8c9-4974-aa11-6129174de1d5 of volume 56c53534-c2df-4fe6-ad56-b40703bb1313 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] snapshot_file for this snap is: volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff75ba0-3f41-4678-b8d7-5d479122f724]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:23 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5
Jul 19 20:04:23 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:23 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f 1073741824" returned: 0 in 0.552s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:23 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f
Jul 19 20:04:23 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:23 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5" returned: 0 in 0.498s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c53534-c2df-4fe6-ad56-b40703bb1313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[11554ed1-0ea1-441e-aa0b-86838d95010b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:23 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313
Jul 19 20:04:23 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:23 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f" returned: 0 in 0.360s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ac82c7-a991-467a-b585-9a0602fe7af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b59327c-d247-4962-9ba4-2b982910e51f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f996e1-0b11-4a13-8ca5-da148f7c9b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:23 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Volume volume-9b59327c-d247-4962-9ba4-2b982910e51f (9b59327c-d247-4962-9ba4-2b982910e51f): created successfully
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f996e1-0b11-4a13-8ca5-da148f7c9b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:23 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Flow 'volume_create_manager' (5d57e8b6-73d2-4d96-94d3-8ec2511d1dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:24 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b42232ae-990e-4ce0-a9b1-563b997ac499 tempest-ProjectReaderTests-1650706838 None] Created volume successfully.
Jul 19 20:04:24 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313" returned: 0 in 0.462s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:24 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5
Jul 19 20:04:24 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:24 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5" returned: 0 in 0.437s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:24 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5
Jul 19 20:04:24 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:24 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313.c6e54ef7-c8c9-4974-aa11-6129174de1d5" returned: 0 in 0.297s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Lock "cinder-quobyte-c6e54ef7-c8c9-4974-aa11-6129174de1d5" released by "_delete_snapshot" :: held 1.877s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Lock "cinder-quobyte-56c53534-c2df-4fe6-ad56-b40703bb1313" released by "delete_snapshot" :: held 1.924s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Created reservations ['e955a660-d24c-456b-a767-e737cf19cce7', 'f53ddf7b-e6b6-4ba7-bbf4-ddb2ed17bd97', 'b545cb55-8c0b-4aa2-88fc-d732fac7e8bf', 'bf445fdf-a62f-4c12-8476-87ecd08d6ebe'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Creating offline snapshot 805db5be-d15c-47d0-9f4e-4a60ff8b75bb of volume 9b59327c-d247-4962-9ba4-2b982910e51f {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dbba25-6de4-4a3a-8f7a-6671f8e982d4]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:25 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Delete snapshot completed successfully.
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b2be7524-50fd-4e4e-88db-9b52b137a9c4 tempest-CinderUnicodeTest-874679568 None] Lock "cinder-c6e54ef7-c8c9-4974-aa11-6129174de1d5-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:25 devstack sudo[106567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f
Jul 19 20:04:25 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:25 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f" returned: 0 in 0.451s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:25 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb 1G
Jul 19 20:04:25 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Acquiring lock "cinder-56c53534-c2df-4fe6-ad56-b40703bb1313-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Lock "cinder-56c53534-c2df-4fe6-ad56-b40703bb1313-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Acquiring lock "cinder-quobyte-56c53534-c2df-4fe6-ad56-b40703bb1313" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Lock "cinder-quobyte-56c53534-c2df-4fe6-ad56-b40703bb1313" acquired by "delete_volume" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:26 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb 1G" returned: 0 in 0.621s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b59327c-d247-4962-9ba4-2b982910e51f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[14271368-8fb7-4f5f-b29e-58bbbbdfe3d8]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:26 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b59327c-d247-4962-9ba4-2b982910e51f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb
Jul 19 20:04:26 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:26 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313
Jul 19 20:04:26 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:26 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b59327c-d247-4962-9ba4-2b982910e51f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb" returned: 0 in 0.378s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:26 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb is being set with open permissions: ugo+rw
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:26 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb
Jul 19 20:04:26 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:26 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313" returned: 0 in 0.493s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:27 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313
Jul 19 20:04:27 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:27 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:27 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.info
Jul 19 20:04:27 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:27 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-56c53534-c2df-4fe6-ad56-b40703bb1313" returned: 0 in 0.397s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Lock "cinder-quobyte-56c53534-c2df-4fe6-ad56-b40703bb1313" released by "delete_volume" :: held 0.974s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Created reservations ['f35a0a89-76ac-4354-9b10-33c93a251dda', '0eb83185-0617-46ce-894e-3bb201eba266', '30732b3c-ae5a-401d-956f-a691fbf862b5', 'd38891d8-4d55-4a1f-af43-1d28c2d0890b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:27 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.info" returned: 0 in 0.421s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:27 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.info is being set with open permissions: ugo+rw
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:27 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.info
Jul 19 20:04:27 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:27 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:27 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:27 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:27 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.info" returned: 0 in 0.381s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.341s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Deleted volume successfully.
Jul 19 20:04:28 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e10652be-c51c-4605-b925-911207575e89 tempest-ProjectReaderTests-1650706838 None] Create snapshot completed successfully
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-c517dcb2-9257-4af8-9647-b8421a25051b tempest-CinderUnicodeTest-874679568 None] Lock "cinder-56c53534-c2df-4fe6-ad56-b40703bb1313-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-805db5be-d15c-47d0-9f4e-4a60ff8b75bb-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-805db5be-d15c-47d0-9f4e-4a60ff8b75bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-9b59327c-d247-4962-9ba4-2b982910e51f" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-9b59327c-d247-4962-9ba4-2b982910e51f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-805db5be-d15c-47d0-9f4e-4a60ff8b75bb" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-805db5be-d15c-47d0-9f4e-4a60ff8b75bb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Deleting offline snapshot 805db5be-d15c-47d0-9f4e-4a60ff8b75bb of volume 9b59327c-d247-4962-9ba4-2b982910e51f {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] snapshot_file for this snap is: volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d40e58c-4a03-4d2b-abcc-d788ad0e6644]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:28 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb
Jul 19 20:04:28 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Acquiring lock "cinder-1e5fa921-d4c2-48a0-9beb-e5328a1b8781-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Lock "cinder-1e5fa921-d4c2-48a0-9beb-e5328a1b8781-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Acquiring lock "cinder-quobyte-1e5fa921-d4c2-48a0-9beb-e5328a1b8781" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Lock "cinder-quobyte-1e5fa921-d4c2-48a0-9beb-e5328a1b8781" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96ab2a4-5747-464b-9e6e-d7cc5bd1d72b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:28 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781
Jul 19 20:04:28 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:28 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb" returned: 0 in 0.424s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b59327c-d247-4962-9ba4-2b982910e51f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cddcc0-7a64-4a40-a303-989424d634f2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:29 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f
Jul 19 20:04:29 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:29 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781" returned: 0 in 0.395s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:29 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781
Jul 19 20:04:29 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:29 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f" returned: 0 in 0.425s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:29 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb
Jul 19 20:04:29 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:29 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1e5fa921-d4c2-48a0-9beb-e5328a1b8781" returned: 0 in 0.291s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Lock "cinder-quobyte-1e5fa921-d4c2-48a0-9beb-e5328a1b8781" released by "delete_volume" :: held 0.743s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Created reservations ['b703b946-9450-4bb7-8b6a-64101659c361', 'd524332c-e2ac-448a-895e-b3a5e0c4d225', '4f5fa85c-3638-476c-b59c-aeee3b1d0f4e', '7157f208-67cf-4bfe-8064-da8de3a1b337'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:29 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:29 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:29 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb" returned: 0 in 0.373s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:29 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb
Jul 19 20:04:29 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:29 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.274s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:29 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Deleted volume successfully.
Jul 19 20:04:29 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f7725816-90aa-4307-b79e-d48ce555482e tempest-CinderUnicodeTest-874679568 None] Lock "cinder-1e5fa921-d4c2-48a0-9beb-e5328a1b8781-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:30 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f.805db5be-d15c-47d0-9f4e-4a60ff8b75bb" returned: 0 in 0.322s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-805db5be-d15c-47d0-9f4e-4a60ff8b75bb" released by "_delete_snapshot" :: held 1.663s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-9b59327c-d247-4962-9ba4-2b982910e51f" released by "delete_snapshot" :: held 1.691s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Created reservations ['4c98d7d9-6bf9-4aad-ae74-413d18e70eed', '796b1db3-b9fd-4248-a793-deb128068c46', '968986e7-eaac-4968-9346-cd129105f569', 'f8048b9d-6924-4165-b3a3-4e3e81c43dc6'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:30 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Delete snapshot completed successfully.
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-09e4ad3f-2c68-409f-ad2f-a6c50c7fa4d1 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-805db5be-d15c-47d0-9f4e-4a60ff8b75bb-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-9b59327c-d247-4962-9ba4-2b982910e51f-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-9b59327c-d247-4962-9ba4-2b982910e51f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "cinder-quobyte-9b59327c-d247-4962-9ba4-2b982910e51f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-9b59327c-d247-4962-9ba4-2b982910e51f" acquired by "delete_volume" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c2960f-583f-499f-b795-32c6bf1ace1d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:30 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f
Jul 19 20:04:30 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:31 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f" returned: 0 in 0.465s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:31 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f
Jul 19 20:04:31 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:31 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-9b59327c-d247-4962-9ba4-2b982910e51f" returned: 0 in 0.323s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-quobyte-9b59327c-d247-4962-9ba4-2b982910e51f" released by "delete_volume" :: held 0.878s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Created reservations ['ba80583b-d9bf-46b6-bfd4-33459c6b0072', 'c28ac4aa-d5a2-49a3-9c3f-58d58d6439b6', '4ecdc141-d0ca-4153-b399-ccd4c9f5cbc8', '5eef4806-aa4e-4fa2-a837-085c309895a1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:31 devstack sudo[106645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:31 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:32 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.347s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:32 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Deleted volume successfully.
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-28546ced-eadd-4a08-8508-68c2161a26b8 tempest-ProjectReaderTests-1650706838 None] Lock "cinder-9b59327c-d247-4962-9ba4-2b982910e51f-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Flow 'volume_create_manager' (d4492f89-d586-4a86-b058-7ca58a610c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8faf4a09-2462-4640-a866-44ed509c351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8faf4a09-2462-4640-a866-44ed509c351d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1874343650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301275de-1240-4fc5-8bf3-62de0c77bd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cec438e9e548ccb9fbd9b23256869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:32Z,use_quota=True,user_id='ce898f16367346dfa53a02b4b5991399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fdb04c-7055-476f-a57b-54422d458da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fdb04c-7055-476f-a57b-54422d458da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b8d11b-275b-49f3-8371-396d37f19688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b8d11b-275b-49f3-8371-396d37f19688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301275de-1240-4fc5-8bf3-62de0c77bd3b', 'volume_name': 'volume-301275de-1240-4fc5-8bf3-62de0c77bd3b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a10536-6e71-434f-80e3-f20c1eee7c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a10536-6e71-434f-80e3-f20c1eee7c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e816fb6d-7fc3-4025-9d46-a7cfbdf4c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:32 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Volume 301275de-1240-4fc5-8bf3-62de0c77bd3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301275de-1240-4fc5-8bf3-62de0c77bd3b', 'volume_size': 1}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1874343650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301275de-1240-4fc5-8bf3-62de0c77bd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cec438e9e548ccb9fbd9b23256869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:32Z,use_quota=True,user_id='ce898f16367346dfa53a02b4b5991399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Creating volume 301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:32 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:32 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b 1073741824
Jul 19 20:04:32 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:32 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b 1073741824" returned: 0 in 0.493s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:32 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b
Jul 19 20:04:32 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:32 devstack sudo[106658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:32 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:33 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b" returned: 0 in 0.344s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e816fb6d-7fc3-4025-9d46-a7cfbdf4c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301275de-1240-4fc5-8bf3-62de0c77bd3b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9308121-f8a0-471e-bf10-f713de12a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:33 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:33 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Volume volume-301275de-1240-4fc5-8bf3-62de0c77bd3b (301275de-1240-4fc5-8bf3-62de0c77bd3b): created successfully
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9308121-f8a0-471e-bf10-f713de12a28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Flow 'volume_create_manager' (d4492f89-d586-4a86-b058-7ca58a610c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.358s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 20:04:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 20:04:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4f84a4a0-a144-4463-8bde-a1a303239232 tempest-SnapshotDependencyTests-2011552859 None] Created volume successfully.
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Creating offline snapshot 1aedca2d-8ef8-4992-a05a-68355087590d of volume 301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[82164439-85d0-4bb3-821b-befdf2060358]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:34 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b
Jul 19 20:04:34 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (f29db8a0-7600-4144-9e23-797a272660fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9a0a2d-cadf-4cd1-841d-1cef1c69241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9a0a2d-cadf-4cd1-841d-1cef1c69241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60932980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:35Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c56b6e-09a5-465a-aa33-0cefd104b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:34 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c56b6e-09a5-465a-aa33-0cefd104b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0065cdd6-ac0e-4241-b16c-b995c64a8300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0065cdd6-ac0e-4241-b16c-b995c64a8300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676', 'volume_name': 'volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979d2627-c70b-4a29-bf98-5c3153b9f277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979d2627-c70b-4a29-bf98-5c3153b9f277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50276f6-c665-40f4-a773-303eb49a2a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:35 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Volume f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676', 'volume_size': 1}
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:35 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b" returned: 0 in 0.415s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:35 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d 1G
Jul 19 20:04:35 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:35 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d 1G" returned: 0 in 0.393s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301275de-1240-4fc5-8bf3-62de0c77bd3b -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:35 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301275de-1240-4fc5-8bf3-62de0c77bd3b -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d
Jul 19 20:04:35 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:35 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301275de-1240-4fc5-8bf3-62de0c77bd3b -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d" returned: 0 in 0.295s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:35 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d is being set with open permissions: ugo+rw
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:35 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d
Jul 19 20:04:35 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:35 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d" returned: 0 in 0.251s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:36 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.info
Jul 19 20:04:36 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Flow 'volume_create_manager' (7141598c-2d6c-4c7e-880e-b68307e1d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e82a359-e80d-4093-b457-6edeea2bf150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e82a359-e80d-4093-b457-6edeea2bf150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1706231669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9feab5-c98b-4a68-9f8f-b381ce0f1111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5c630b0ce94ff49659c287733d3bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:36Z,use_quota=True,user_id='af98f21818454c39aa85d7f382cf0c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bb9bc2-7d8f-4f24-af6d-55a8fbd77c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bb9bc2-7d8f-4f24-af6d-55a8fbd77c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf82a14c-1e0c-49f9-b1c1-bdde35d65ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf82a14c-1e0c-49f9-b1c1-bdde35d65ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9feab5-c98b-4a68-9f8f-b381ce0f1111', 'volume_name': 'volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba18c351-e6b7-4d75-86a0-95c01b9c6af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba18c351-e6b7-4d75-86a0-95c01b9c6af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f49f1ff-41a6-4204-96a0-22e48ea85b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:36 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Volume 2a9feab5-c98b-4a68-9f8f-b381ce0f1111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111', 'volume_size': 1}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:36 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.info" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:36 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.info is being set with open permissions: ugo+rw
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:36 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.info
Jul 19 20:04:36 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:36 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.info" returned: 0 in 0.245s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60932980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:35Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Creating volume f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:36 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:36 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 1073741824
Jul 19 20:04:36 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-a59f3837-f937-4c4c-af44-b28f924de50c tempest-SnapshotDependencyTests-2011552859 None] Create snapshot completed successfully
Jul 19 20:04:36 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 1073741824" returned: 0 in 0.412s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:37 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676
Jul 19 20:04:37 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:37 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" returned: 0 in 0.244s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1706231669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9feab5-c98b-4a68-9f8f-b381ce0f1111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5c630b0ce94ff49659c287733d3bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:36Z,use_quota=True,user_id='af98f21818454c39aa85d7f382cf0c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Creating volume 2a9feab5-c98b-4a68-9f8f-b381ce0f1111 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:37 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50276f6-c665-40f4-a773-303eb49a2a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:37 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111 1073741824
Jul 19 20:04:37 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07192cf2-8cd9-4227-839f-e954e56a519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:37 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Volume volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 (f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676): created successfully
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07192cf2-8cd9-4227-839f-e954e56a519c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (f29db8a0-7600-4144-9e23-797a272660fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:37 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-bf1d5127-0721-4902-90b7-572b155c8e17 tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:04:37 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111 1073741824" returned: 0 in 0.442s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:37 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111
Jul 19 20:04:37 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:37 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111" returned: 0 in 0.248s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f49f1ff-41a6-4204-96a0-22e48ea85b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:37 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3c55f8-79f6-4fc4-8db2-748dca3558e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:38 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Volume volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111 (2a9feab5-c98b-4a68-9f8f-b381ce0f1111): created successfully
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3c55f8-79f6-4fc4-8db2-748dca3558e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Flow 'volume_create_manager' (7141598c-2d6c-4c7e-880e-b68307e1d378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c6b576f5-a4b9-440c-b228-fbc97a1bcea7 tempest-ProjectReaderTests-318048472 None] Created volume successfully.
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Flow 'volume_create_manager' (c6205a10-61b9-4dc3-9c00-be37b932399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438f5db3-043a-4c64-9280-6dd5789e52ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438f5db3-043a-4c64-9280-6dd5789e52ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9f20b4-7d59-4bc7-8df5-42e7185149ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cec438e9e548ccb9fbd9b23256869e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1aedca2d-8ef8-4992-a05a-68355087590d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:38Z,use_quota=True,user_id='ce898f16367346dfa53a02b4b5991399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3045f38-d948-413d-bbcd-94cfef578b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3045f38-d948-413d-bbcd-94cfef578b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876c286d-9c2a-4e8a-a961-1931430c93d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876c286d-9c2a-4e8a-a961-1931430c93d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c9f20b4-7d59-4bc7-8df5-42e7185149ae', 'volume_name': 'volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae', 'volume_size': 1, 'snapshot_id': '1aedca2d-8ef8-4992-a05a-68355087590d'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7c5c61-b6ac-4f71-b583-ec7831694760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7c5c61-b6ac-4f71-b583-ec7831694760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460f5787-2617-48c8-91e7-4e490840a88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:38 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Volume 7c9f20b4-7d59-4bc7-8df5-42e7185149ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae', 'volume_size': 1, 'snapshot_id': '1aedca2d-8ef8-4992-a05a-68355087590d'}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-quobyte-1aedca2d-8ef8-4992-a05a-68355087590d-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" by "_create_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Acquiring lock "cinder-2a9feab5-c98b-4a68-9f8f-b381ce0f1111-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Lock "cinder-2a9feab5-c98b-4a68-9f8f-b381ce0f1111-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-1aedca2d-8ef8-4992-a05a-68355087590d-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Creating volume 7c9f20b4-7d59-4bc7-8df5-42e7185149ae from snapshot 1aedca2d-8ef8-4992-a05a-68355087590d {{(pid=87353) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-quobyte-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" by "_copy_volume_from_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] snapshot: 1aedca2d-8ef8-4992-a05a-68355087590d, volume: 7c9f20b4-7d59-4bc7-8df5-42e7185149ae,  {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Acquiring lock "cinder-quobyte-2a9feab5-c98b-4a68-9f8f-b381ce0f1111" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac6545-8d13-4fe3-ace1-d560df26b692]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Lock "cinder-quobyte-2a9feab5-c98b-4a68-9f8f-b381ce0f1111" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd15a0e-d159-40ad-89e4-8fdb537db9c9]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:38 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d
Jul 19 20:04:38 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:38 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111
Jul 19 20:04:38 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:38 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d" returned: 0 in 0.371s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301275de-1240-4fc5-8bf3-62de0c77bd3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 19 20:04:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Creating direct copy from snapshot {{(pid=87353) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a268e7ee-9ab5-4973-bf35-48b59fcdb671]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:39 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111" returned: 0 in 0.364s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:39 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111
Jul 19 20:04:39 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:39 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b
Jul 19 20:04:39 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:39 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2a9feab5-c98b-4a68-9f8f-b381ce0f1111" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Lock "cinder-quobyte-2a9feab5-c98b-4a68-9f8f-b381ce0f1111" released by "delete_volume" :: held 0.650s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Created reservations ['f06778d9-1195-4044-bab5-cad366f310b0', '69bde0a6-7930-483c-91ba-1db2922d0d30', 'e44dbdfd-749e-4f49-929c-77d47b25c5d5', 'ce114c19-864a-4b66-86e5-667a0aee8bb2'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:39 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b" returned: 0 in 0.377s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG cinder.utils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Path /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae not found in is_blk_device check {{(pid=87353) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:39 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae
Jul 19 20:04:39 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:39 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:39 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:39 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.281s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:39 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Deleted volume successfully.
Jul 19 20:04:39 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-138b7890-b8f7-45e8-81f5-cbe2a461279e tempest-ProjectReaderTests-318048472 None] Lock "cinder-2a9feab5-c98b-4a68-9f8f-b381ce0f1111-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Flow 'volume_create_manager' (f9c45698-c0b0-4417-8b4d-4ab43aa4de93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c517b64d-68b6-40e2-ab86-1185bc58966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c517b64d-68b6-40e2-ab86-1185bc58966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525017881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6df2699-25a0-4f2d-bfa8-116c692f2dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5c630b0ce94ff49659c287733d3bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:41Z,use_quota=True,user_id='af98f21818454c39aa85d7f382cf0c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfbf373-67f0-4c4d-93b2-07d3d1730a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfbf373-67f0-4c4d-93b2-07d3d1730a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f231e7ed-339f-4b42-aa03-05f5bfeb2159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f231e7ed-339f-4b42-aa03-05f5bfeb2159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6df2699-25a0-4f2d-bfa8-116c692f2dfc', 'volume_name': 'volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100d3eca-5087-4e17-b9b5-af3526a87fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100d3eca-5087-4e17-b9b5-af3526a87fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a780b5a-6c8f-4a3f-8068-40f5587e8860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:40 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Volume a6df2699-25a0-4f2d-bfa8-116c692f2dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc', 'volume_size': 1}
Jul 19 20:04:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:43 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" returned: 0 in 4.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[232082c7-76a3-4ada-9bad-0ce0f1cef7f1]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:43 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b
Jul 19 20:04:43 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:44 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b" returned: 0 in 0.516s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG cinder.image.image_utils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae {{(pid=87353) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 19 20:04:44 devstack cinder-volume[87353]: INFO cinder.image.image_utils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Converted 1024.00 MB image at 240.88 MB/s
Jul 19 20:04:44 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae is being set with open permissions: ugo+rw
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:44 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae
Jul 19 20:04:44 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:44 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" returned: 0 in 0.234s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" released by "_copy_volume_from_snapshot" :: held 5.840s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-1aedca2d-8ef8-4992-a05a-68355087590d-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" released by "_create_volume_from_snapshot" :: held 5.875s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.915s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.891s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot 9c4295b6-03a1-4620-9a79-d121e26d4384 of volume f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (460f5787-2617-48c8-91e7-4e490840a88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae', 'volume_size': 1, 'snapshot_id': '1aedca2d-8ef8-4992-a05a-68355087590d'}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d8a69c-3f3a-4c38-9cb5-37debdda350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be3edd3-c9d8-4880-8754-51dab0ebcc34]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:44 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Volume volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae (7c9f20b4-7d59-4bc7-8df5-42e7185149ae): created successfully
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d8a69c-3f3a-4c38-9cb5-37debdda350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Flow 'volume_create_manager' (c6205a10-61b9-4dc3-9c00-be37b932399d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:44 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-46426d38-4d50-40ad-b885-db5c69888a65 tempest-SnapshotDependencyTests-2011552859 None] Created volume successfully.
Jul 19 20:04:44 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676
Jul 19 20:04:44 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:44 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" returned: 0 in 0.363s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:44 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 1G
Jul 19 20:04:44 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-1aedca2d-8ef8-4992-a05a-68355087590d-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-1aedca2d-8ef8-4992-a05a-68355087590d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-quobyte-301275de-1240-4fc5-8bf3-62de0c77bd3b" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-301275de-1240-4fc5-8bf3-62de0c77bd3b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-quobyte-1aedca2d-8ef8-4992-a05a-68355087590d" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-1aedca2d-8ef8-4992-a05a-68355087590d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Deleting offline snapshot 1aedca2d-8ef8-4992-a05a-68355087590d of volume 301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] snapshot_file for this snap is: volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b582a4d-3628-4efe-8f9a-2d495db3dafe]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:45 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 1G" returned: 0 in 0.409s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:45 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384
Jul 19 20:04:45 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d
Jul 19 20:04:45 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:45 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:45 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d" returned: 0 in 0.361s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301275de-1240-4fc5-8bf3-62de0c77bd3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:04:45 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384" returned: 0 in 0.299s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:45 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 is being set with open permissions: ugo+rw
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7df041-e7f6-40c8-b4ee-da5f5e90dd00]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:45 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384
Jul 19 20:04:45 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:45 devstack sudo[106777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b
Jul 19 20:04:45 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:45 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384" returned: 0 in 0.242s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:45 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.info
Jul 19 20:04:45 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:45 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b" returned: 0 in 0.385s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:45 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d
Jul 19 20:04:45 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:46 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.info" returned: 0 in 0.259s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:46 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.info is being set with open permissions: ugo+rw
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:46 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.info
Jul 19 20:04:46 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:46 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d" returned: 0 in 0.332s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:46 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d
Jul 19 20:04:46 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:46 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.info" returned: 0 in 0.258s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.418s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525017881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6df2699-25a0-4f2d-bfa8-116c692f2dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5c630b0ce94ff49659c287733d3bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:41Z,use_quota=True,user_id='af98f21818454c39aa85d7f382cf0c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Creating volume a6df2699-25a0-4f2d-bfa8-116c692f2dfc {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:46 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:46 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc 1073741824
Jul 19 20:04:46 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-bb6ac4c2-9885-4382-b47e-1bef20d9ad93 tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:04:46 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b.1aedca2d-8ef8-4992-a05a-68355087590d" returned: 0 in 0.254s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-1aedca2d-8ef8-4992-a05a-68355087590d" released by "_delete_snapshot" :: held 1.435s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-301275de-1240-4fc5-8bf3-62de0c77bd3b" released by "delete_snapshot" :: held 1.457s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Created reservations ['7603634c-9e94-419d-bac8-9e35d01e7e74', '332f86c0-0f2b-4ece-86ce-62fd33630c41', 'c459f86f-7111-456e-8996-87639a8666eb', '670de8f9-493b-4f87-84cb-963385b437d0'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:46 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Delete snapshot completed successfully.
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-2219169a-ec1b-424c-af55-b1d9609bbc9e tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-1aedca2d-8ef8-4992-a05a-68355087590d-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:46 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc 1073741824" returned: 0 in 0.453s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:46 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc
Jul 19 20:04:46 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:46 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-9c4295b6-03a1-4620-9a79-d121e26d4384-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-9c4295b6-03a1-4620-9a79-d121e26d4384-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-9c4295b6-03a1-4620-9a79-d121e26d4384" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-9c4295b6-03a1-4620-9a79-d121e26d4384" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot 9c4295b6-03a1-4620-9a79-d121e26d4384 of volume f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4d0b79-27b4-4833-a1af-b6f01d4bbc32]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:47 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a780b5a-6c8f-4a3f-8068-40f5587e8860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2ccf6e-afa6-4bfb-9dff-cd1006f34722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:47 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Volume volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc (a6df2699-25a0-4f2d-bfa8-116c692f2dfc): created successfully
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2ccf6e-afa6-4bfb-9dff-cd1006f34722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Flow 'volume_create_manager' (f9c45698-c0b0-4417-8b4d-4ab43aa4de93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8d15c814-10e5-4e30-b30a-9f8fcbc25a3f tempest-ProjectReaderTests-318048472 None] Created volume successfully.
Jul 19 20:04:47 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384
Jul 19 20:04:47 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-301275de-1240-4fc5-8bf3-62de0c77bd3b-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-301275de-1240-4fc5-8bf3-62de0c77bd3b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-quobyte-301275de-1240-4fc5-8bf3-62de0c77bd3b" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-301275de-1240-4fc5-8bf3-62de0c77bd3b" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f8eea9-2331-4140-aaf6-97a95e8bd155]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:47 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:47 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b
Jul 19 20:04:47 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384" returned: 0 in 0.379s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc85371c-498a-49fa-98fa-325a7a6301b4]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:47 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676
Jul 19 20:04:47 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:47 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b" returned: 0 in 0.373s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:47 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b
Jul 19 20:04:47 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:47 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" returned: 0 in 0.361s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:47 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384
Jul 19 20:04:47 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:47 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-301275de-1240-4fc5-8bf3-62de0c77bd3b" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Acquiring lock "cinder-a6df2699-25a0-4f2d-bfa8-116c692f2dfc-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-301275de-1240-4fc5-8bf3-62de0c77bd3b" released by "delete_volume" :: held 0.699s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Lock "cinder-a6df2699-25a0-4f2d-bfa8-116c692f2dfc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Acquiring lock "cinder-quobyte-a6df2699-25a0-4f2d-bfa8-116c692f2dfc" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Created reservations ['2b2c1df4-8407-4a2b-8899-68773a47f4b3', 'db369c55-08dc-4714-9aca-abf40ac4a90c', 'ba752c79-4b3e-453b-acfe-11c07f623e1d', '45de615f-c512-4cb0-8ec5-b9276c47080f'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Lock "cinder-quobyte-a6df2699-25a0-4f2d-bfa8-116c692f2dfc" acquired by "delete_volume" :: waited 0.020s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d903e-ba38-4d45-bd25-9337a0007f5d]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:48 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:48 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:48 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc
Jul 19 20:04:48 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384" returned: 0 in 0.404s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:48 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:48 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384
Jul 19 20:04:48 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-7c9f20b4-7d59-4bc7-8df5-42e7185149ae-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-7c9f20b4-7d59-4bc7-8df5-42e7185149ae-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "cinder-quobyte-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:48 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.353s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ef643-b1e9-46fb-ba63-34c85d444ba0]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:48 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:48 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Deleted volume successfully.
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676.9c4295b6-03a1-4620-9a79-d121e26d4384" returned: 0 in 0.365s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:48 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc" returned: 0 in 0.535s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e339c314-2459-4961-b106-093bc364f956 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-301275de-1240-4fc5-8bf3-62de0c77bd3b-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-9c4295b6-03a1-4620-9a79-d121e26d4384" released by "_delete_snapshot" :: held 1.640s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:48 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" released by "delete_snapshot" :: held 1.666s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:48 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:48 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae
Jul 19 20:04:48 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Created reservations ['3fffb7ff-1db9-450b-8dec-959e69d1eb5b', 'fb64d774-20d4-4bbe-a5d2-3dc5fd38dc49', '7b3d104f-7391-4937-b981-8ba75b200b39', '96d90e55-6377-43a4-abd2-cec1b76f8337'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:48 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0f0e587e-b4e5-4d54-9be4-92c9dc3a2725 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-9c4295b6-03a1-4620-9a79-d121e26d4384-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:48 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-a6df2699-25a0-4f2d-bfa8-116c692f2dfc" returned: 0 in 0.273s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Lock "cinder-quobyte-a6df2699-25a0-4f2d-bfa8-116c692f2dfc" released by "delete_volume" :: held 0.852s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:48 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" returned: 0 in 0.379s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:49 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae
Jul 19 20:04:49 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Created reservations ['2e42b3d3-5b8e-4995-bb8b-49e1fcee5bd7', '2695340d-eeb3-4fc8-8d1a-0a91d181e6e6', '8158663c-0193-4160-a1dd-07166ea16303', 'c9dd5d94-b18b-44ec-9eae-fae9d1f3a2fe'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:49 devstack sudo[106850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:49 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:49 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" returned: 0 in 0.347s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" acquired by "delete_volume" :: waited 0.033s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-quobyte-7c9f20b4-7d59-4bc7-8df5-42e7185149ae" released by "delete_volume" :: held 0.824s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[c407e558-9962-4308-9958-faef401c3e0c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:49 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.315s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Deleted volume successfully.
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b4ed0e8f-7b77-4896-b71b-836dbbd65292 tempest-ProjectReaderTests-318048472 None] Lock "cinder-a6df2699-25a0-4f2d-bfa8-116c692f2dfc-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Created reservations ['a73d04da-974b-4282-bda2-bc8cf4137ca0', 'c4ece085-d9a5-4ea5-95ba-0ff7f5c4442c', '495e4449-cf5f-402f-8ef0-27571c847e9b', 'e971d716-3da6-459d-9792-9d7354799256'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:49 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676
Jul 19 20:04:49 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:49 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:49 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:49 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" returned: 0 in 0.460s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:49 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.328s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:49 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676
Jul 19 20:04:49 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Deleted volume successfully.
Jul 19 20:04:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-456ad6d3-0b8e-42a2-95c7-b8345d3d01d7 tempest-SnapshotDependencyTests-2011552859 None] Lock "cinder-7c9f20b4-7d59-4bc7-8df5-42e7185149ae-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:50 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676" released by "delete_volume" :: held 0.824s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Created reservations ['fa50b0a3-e3ce-4620-afb1-6fc4b49a6310', '4ad912bd-0026-4c30-a119-48d9101c9085', '96eee76d-43a4-410b-9be5-c68bd91b5a73', '6d8f0d60-7d8d-4234-bd24-860634ae192d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:50 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:50 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:50 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.358s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:50 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-b08eeea9-b041-4456-b4e9-98403596521d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-f5711aa2-4b2c-47ff-8f3b-1cf16e3b5676-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:50 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (3eb6b52c-fb4f-45ee-8221-4aef4ffba8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b193be7-07db-468a-a26b-d4cb78279afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b193be7-07db-468a-a26b-d4cb78279afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-590716365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c9c8b5-004f-4906-968e-97f7f0e2cf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:51Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88fe2ef-1f99-446f-87c1-878531144d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88fe2ef-1f99-446f-87c1-878531144d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4548f052-2153-4b83-8e44-282575a4ac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4548f052-2153-4b83-8e44-282575a4ac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c9c8b5-004f-4906-968e-97f7f0e2cf5d', 'volume_name': 'volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5b2e00-588c-4601-be1c-452a10557772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5b2e00-588c-4601-be1c-452a10557772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998ad79b-9cba-4086-8397-ffabaa1cd3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:51 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Volume f4c9c8b5-004f-4906-968e-97f7f0e2cf5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d', 'volume_size': 1}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-590716365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c9c8b5-004f-4906-968e-97f7f0e2cf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:04:51Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Creating volume f4c9c8b5-004f-4906-968e-97f7f0e2cf5d {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:04:51 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:51 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d 1073741824
Jul 19 20:04:51 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:51 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d 1073741824" returned: 0 in 0.519s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:51 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d
Jul 19 20:04:51 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:51 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" returned: 0 in 0.263s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998ad79b-9cba-4086-8397-ffabaa1cd3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab9cd22-a195-40d7-a24d-bde61023b41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:04:51 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Volume volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d (f4c9c8b5-004f-4906-968e-97f7f0e2cf5d): created successfully
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab9cd22-a195-40d7-a24d-bde61023b41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:04:51 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (3eb6b52c-fb4f-45ee-8221-4aef4ffba8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:04:51 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ea2d5470-7776-4d3e-891e-778c61d3fed0 tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:04:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:53 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot e3ea2036-9451-4c18-aaf4-f80439609c64 of volume f4c9c8b5-004f-4906-968e-97f7f0e2cf5d {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:04:53 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[952fd86a-6f1c-4b40-8e5d-7393917d4f01]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:53 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d
Jul 19 20:04:53 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:53 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" returned: 0 in 0.426s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:53 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:53 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 1G
Jul 19 20:04:53 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:54 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 1G" returned: 0 in 0.509s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:54 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64
Jul 19 20:04:54 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:54 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64" returned: 0 in 0.337s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:54 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 is being set with open permissions: ugo+rw
Jul 19 20:04:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:54 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64
Jul 19 20:04:54 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:54 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64" returned: 0 in 0.322s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:54 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:54 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.info
Jul 19 20:04:54 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:55 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.info" returned: 0 in 0.263s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:55 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.info is being set with open permissions: ugo+rw
Jul 19 20:04:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:55 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.info
Jul 19 20:04:55 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:55 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.info" returned: 0 in 0.299s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:55 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:55 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e6de4c55-c40b-4e9e-94a9-f332abe651c6 tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-e3ea2036-9451-4c18-aaf4-f80439609c64-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-e3ea2036-9451-4c18-aaf4-f80439609c64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-e3ea2036-9451-4c18-aaf4-f80439609c64" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-e3ea2036-9451-4c18-aaf4-f80439609c64" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot e3ea2036-9451-4c18-aaf4-f80439609c64 of volume f4c9c8b5-004f-4906-968e-97f7f0e2cf5d {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[146d8da8-62a1-4199-bcb7-bea4d059748b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:56 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:56 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64
Jul 19 20:04:56 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:57 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64" returned: 0 in 0.469s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:57 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:04:57 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eb1e45-e6b3-4a0f-8faf-915382bac666]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:57 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d
Jul 19 20:04:57 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:57 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" returned: 0 in 0.384s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:57 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64
Jul 19 20:04:57 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:57 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64" returned: 0 in 0.367s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:57 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:57 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64
Jul 19 20:04:57 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:58 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d.e3ea2036-9451-4c18-aaf4-f80439609c64" returned: 0 in 0.267s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=236,cinder:SELECT=180,cinder:INSERT=57,cinder:DELETE=25 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:UPDATE=239,cinder:SELECT=170,cinder:DELETE=14,cinder:INSERT=65 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-e3ea2036-9451-4c18-aaf4-f80439609c64" released by "_delete_snapshot" :: held 1.608s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" released by "delete_snapshot" :: held 1.632s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Created reservations ['401bafdb-80bf-4924-b37f-668622be8bdd', 'b79b40e4-b884-4bc1-91f2-113f841665e7', '6cb73ffa-48b1-4eba-af37-a00bf7ea9dbd', 'a599d1f6-361a-4e91-b43e-32907ac5ae2b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:58 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-3522d327-6be1-4bc8-baab-474983d84b0f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-e3ea2036-9451-4c18-aaf4-f80439609c64-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Lock "cinder-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" acquired by "delete_volume" :: waited 0.021s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccfeee5-e457-454c-9ee7-96f2a008f9d5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:04:58 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:59 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d
Jul 19 20:04:59 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:59 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" returned: 0 in 0.384s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:59 devstack sudo[106935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d
Jul 19 20:04:59 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:59 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" returned: 0 in 0.258s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d" released by "delete_volume" :: held 0.708s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Created reservations ['43805fcd-c48b-4a22-b20c-03a5e36a40f8', 'c9f68889-18d8-4ab5-a3d6-75e0932966d2', '31d682cb-b6ea-485c-8edd-c0d0de832acb', 'a23155d3-23e3-4e18-8697-8958c6f66034'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:04:59 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:04:59 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:04:59 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:04:59 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:04:59 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-69db8e45-bee0-4cc9-ba64-82676e5c31ad tempest-ProjectMemberTests-1586216467 None] Lock "cinder-f4c9c8b5-004f-4906-968e-97f7f0e2cf5d-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (220482c1-2edb-43eb-93d5-c6707969128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872950ee-e87c-47ea-a862-579c797cfd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872950ee-e87c-47ea-a862-579c797cfd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072501606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f0c6c1-4613-4e2d-90eb-439b70b6315f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:00Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65827c4-5161-415f-905f-6b76d06c4d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65827c4-5161-415f-905f-6b76d06c4d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8508ce5b-e8d4-469f-982a-0bf0b8f1c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8508ce5b-e8d4-469f-982a-0bf0b8f1c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f0c6c1-4613-4e2d-90eb-439b70b6315f', 'volume_name': 'volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3839ff-50f2-4389-9ac1-3025f89e5a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3839ff-50f2-4389-9ac1-3025f89e5a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bdb0db-45cb-4bfc-a38f-4832c7ed8a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:00 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Volume c1f0c6c1-4613-4e2d-90eb-439b70b6315f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f', 'volume_size': 1}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072501606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f0c6c1-4613-4e2d-90eb-439b70b6315f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:00Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Creating volume c1f0c6c1-4613-4e2d-90eb-439b70b6315f {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:05:00 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:00 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f 1073741824
Jul 19 20:05:00 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:00 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f 1073741824" returned: 0 in 0.404s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:00 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:00 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f
Jul 19 20:05:00 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:01 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" returned: 0 in 0.235s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88bdb0db-45cb-4bfc-a38f-4832c7ed8a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e1b4ea-ea74-4c41-ab03-d600892206a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:01 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Volume volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f (c1f0c6c1-4613-4e2d-90eb-439b70b6315f): created successfully
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e1b4ea-ea74-4c41-ab03-d600892206a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (220482c1-2edb-43eb-93d5-c6707969128e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:01 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-dbebf303-7cf1-4bb8-b7be-321c4b66ccd6 tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot 15770a89-0de8-44a5-a6e6-389faea9fe51 of volume c1f0c6c1-4613-4e2d-90eb-439b70b6315f {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[576bbaa6-2b60-48fc-adee-dd3467a9c972]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:01 devstack sudo[106952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f
Jul 19 20:05:01 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:01 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" returned: 0 in 0.338s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:01 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:01 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 1G
Jul 19 20:05:01 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:02 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 1G" returned: 0 in 0.373s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:02 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51
Jul 19 20:05:02 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:02 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51" returned: 0 in 0.279s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:02 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 is being set with open permissions: ugo+rw
Jul 19 20:05:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:02 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51
Jul 19 20:05:02 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:02 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51" returned: 0 in 0.233s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:02 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:02 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.info
Jul 19 20:05:02 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:03 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.info" returned: 0 in 0.248s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:03 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.info is being set with open permissions: ugo+rw
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:03 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.info
Jul 19 20:05:03 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:03 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.info" returned: 0 in 0.237s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.781s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:03 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-52a9a56b-273e-4d28-bcda-8375547b371e tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-15770a89-0de8-44a5-a6e6-389faea9fe51-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Lock "cinder-15770a89-0de8-44a5-a6e6-389faea9fe51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-15770a89-0de8-44a5-a6e6-389faea9fe51" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-15770a89-0de8-44a5-a6e6-389faea9fe51" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot 15770a89-0de8-44a5-a6e6-389faea9fe51 of volume c1f0c6c1-4613-4e2d-90eb-439b70b6315f {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b9a169-c0b7-4d7d-9d60-790deb500239]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:03 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:03 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51
Jul 19 20:05:03 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:04 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51" returned: 0 in 0.348s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:04 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:05:04 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b538c-2640-4bfe-9904-085146477292]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:04 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f
Jul 19 20:05:04 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:04 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" returned: 0 in 0.355s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:04 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51
Jul 19 20:05:04 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:04 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51" returned: 0 in 0.323s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:04 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:04 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51
Jul 19 20:05:04 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:05 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f.15770a89-0de8-44a5-a6e6-389faea9fe51" returned: 0 in 0.239s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-15770a89-0de8-44a5-a6e6-389faea9fe51" released by "_delete_snapshot" :: held 1.345s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" released by "delete_snapshot" :: held 1.364s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Created reservations ['e44b331d-6365-4572-9fff-1beedcfdc3da', 'e8179727-e5ac-430b-abed-499a2675cae9', 'c62dcc2f-8847-43f0-a0d3-88b30565e6b4', '4eb12847-c9f4-46dd-9ea8-fade25b1fabf'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:05 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7a50ebd8-ed5b-415a-a909-6cae5bf377cc tempest-ProjectMemberTests-1586216467 None] Lock "cinder-15770a89-0de8-44a5-a6e6-389faea9fe51-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-c1f0c6c1-4613-4e2d-90eb-439b70b6315f-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-c1f0c6c1-4613-4e2d-90eb-439b70b6315f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[35483592-8136-45f0-8270-8ec855bca5c8]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:05 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:05 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f
Jul 19 20:05:05 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:06 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" returned: 0 in 0.348s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:06 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f
Jul 19 20:05:06 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:06 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" returned: 0 in 0.241s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-c1f0c6c1-4613-4e2d-90eb-439b70b6315f" released by "delete_volume" :: held 0.646s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Created reservations ['e79cc993-ab70-411e-94b1-1e2d02e8151b', '520f758d-98a3-468c-9082-18d6825dd06a', '3b1e9008-6e1e-483b-a367-396856aaa430', 'a4f0b8f1-6aa0-47f9-b729-57233a48cdca'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:06 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:05:06 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:06 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.233s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:05:06 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:05:06 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-68005ffd-cab9-4685-a23d-bc54fb7f9603 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-c1f0c6c1-4613-4e2d-90eb-439b70b6315f-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (6bd41e25-b7aa-4baa-8a60-e8aca7840557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d55b9b-e5d4-410e-a93c-0a89ca947591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d55b9b-e5d4-410e-a93c-0a89ca947591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345554257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2299839a-1ee2-410a-b703-9ae459c96f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:07Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6486f5f3-02ce-4ecf-ae67-3b6b2d3a2009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6486f5f3-02ce-4ecf-ae67-3b6b2d3a2009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6803e1a8-f142-4b08-b4e4-e0bfecf30f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6803e1a8-f142-4b08-b4e4-e0bfecf30f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2299839a-1ee2-410a-b703-9ae459c96f3a', 'volume_name': 'volume-2299839a-1ee2-410a-b703-9ae459c96f3a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8dd006-36e5-4587-970e-949353640d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8dd006-36e5-4587-970e-949353640d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff94f017-02b0-49c1-ae3d-b332a62e95d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:07 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Volume 2299839a-1ee2-410a-b703-9ae459c96f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2299839a-1ee2-410a-b703-9ae459c96f3a', 'volume_size': 1}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345554257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2299839a-1ee2-410a-b703-9ae459c96f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:07Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Creating volume 2299839a-1ee2-410a-b703-9ae459c96f3a {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:05:07 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:07 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a 1073741824
Jul 19 20:05:07 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:07 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a 1073741824" returned: 0 in 0.401s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:07 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:07 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a
Jul 19 20:05:07 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:08 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a" returned: 0 in 0.244s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff94f017-02b0-49c1-ae3d-b332a62e95d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2299839a-1ee2-410a-b703-9ae459c96f3a', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57bce19-3093-4220-934e-82a93384fc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:08 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Volume volume-2299839a-1ee2-410a-b703-9ae459c96f3a (2299839a-1ee2-410a-b703-9ae459c96f3a): created successfully
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57bce19-3093-4220-934e-82a93384fc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (6bd41e25-b7aa-4baa-8a60-e8aca7840557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:08 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-16076636-6094-4249-b80e-ecaf8ad98158 tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot 255df580-3311-4bef-9e4e-cfb91b9cce13 of volume 2299839a-1ee2-410a-b703-9ae459c96f3a {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd03f24-d2bc-4392-b378-e93a94fcef91]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:08 devstack sudo[107014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a
Jul 19 20:05:08 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:08 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a" returned: 0 in 0.349s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:08 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:08 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 1G
Jul 19 20:05:08 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:09 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 1G" returned: 0 in 0.376s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2299839a-1ee2-410a-b703-9ae459c96f3a -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:09 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2299839a-1ee2-410a-b703-9ae459c96f3a -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13
Jul 19 20:05:09 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:09 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2299839a-1ee2-410a-b703-9ae459c96f3a -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13" returned: 0 in 0.310s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:09 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 is being set with open permissions: ugo+rw
Jul 19 20:05:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:09 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13
Jul 19 20:05:09 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:09 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13" returned: 0 in 0.236s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:09 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:09 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.info
Jul 19 20:05:09 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:10 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.info" returned: 0 in 0.243s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:10 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.info is being set with open permissions: ugo+rw
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:10 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.info
Jul 19 20:05:10 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:10 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.info" returned: 0 in 0.235s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:10 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-8e0e4aea-9a83-4f09-ae74-5281bcf529d0 tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-255df580-3311-4bef-9e4e-cfb91b9cce13-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-255df580-3311-4bef-9e4e-cfb91b9cce13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-2299839a-1ee2-410a-b703-9ae459c96f3a" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-2299839a-1ee2-410a-b703-9ae459c96f3a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-255df580-3311-4bef-9e4e-cfb91b9cce13" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-255df580-3311-4bef-9e4e-cfb91b9cce13" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot 255df580-3311-4bef-9e4e-cfb91b9cce13 of volume 2299839a-1ee2-410a-b703-9ae459c96f3a {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[497247bf-866c-4899-b361-66a73b1a7541]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:10 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:10 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13
Jul 19 20:05:10 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:11 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13" returned: 0 in 0.350s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:11 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2299839a-1ee2-410a-b703-9ae459c96f3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:05:11 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f558a7d-3861-4a99-9e28-1df0a48a161b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:11 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a
Jul 19 20:05:11 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:11 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a" returned: 0 in 0.347s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:11 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13
Jul 19 20:05:11 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:11 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13" returned: 0 in 0.326s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:11 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:11 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13
Jul 19 20:05:11 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:12 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a.255df580-3311-4bef-9e4e-cfb91b9cce13" returned: 0 in 0.234s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-255df580-3311-4bef-9e4e-cfb91b9cce13" released by "_delete_snapshot" :: held 1.340s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-2299839a-1ee2-410a-b703-9ae459c96f3a" released by "delete_snapshot" :: held 1.360s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Created reservations ['6d4ab3b8-58d2-4921-a0a2-e2c093752c04', '7dc9dcb4-0344-4dd1-bce9-f5d05be0ca88', 'b95cfcd0-553c-4830-aeb7-ba0e7e125f1c', 'dfe0b6a9-7399-41d1-91ad-9b6f76b3768a'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:12 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6865dabe-1bf6-448e-8331-13652f33b794 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-255df580-3311-4bef-9e4e-cfb91b9cce13-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-2299839a-1ee2-410a-b703-9ae459c96f3a-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-2299839a-1ee2-410a-b703-9ae459c96f3a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-2299839a-1ee2-410a-b703-9ae459c96f3a" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-2299839a-1ee2-410a-b703-9ae459c96f3a" acquired by "delete_volume" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[58606bde-ae9c-4c31-bd92-bfb0977bdce6]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:12 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:13 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a
Jul 19 20:05:13 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:13 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a" returned: 0 in 0.353s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:13 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a
Jul 19 20:05:13 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:13 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-2299839a-1ee2-410a-b703-9ae459c96f3a" returned: 0 in 0.242s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-2299839a-1ee2-410a-b703-9ae459c96f3a" released by "delete_volume" :: held 0.659s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Created reservations ['591f4191-dc65-4991-833f-7ce4b3092c3c', '4b273a70-91f4-43d0-a991-2db0f2381de6', '21759a58-8a9e-4875-ac12-3aef52207505', '16513cff-e932-4e53-8825-fbddead30fa3'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:13 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:05:13 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:13 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.256s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:05:13 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:05:13 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-52f5bcf4-53d4-44dc-8d29-4fe88201eb1f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-2299839a-1ee2-410a-b703-9ae459c96f3a-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (b09c3ecb-ec2a-4a35-a224-8289c57a7197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77259afe-19b5-4fa8-8ebd-9f7f7e8f46c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77259afe-19b5-4fa8-8ebd-9f7f7e8f46c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213515126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54359ee4-b095-40c5-a191-fde914c31ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:14Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd82392-cd2a-4190-8846-8b5d1260c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd82392-cd2a-4190-8846-8b5d1260c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0bc4e4-d5f3-4651-8011-5459d5932ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0bc4e4-d5f3-4651-8011-5459d5932ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54359ee4-b095-40c5-a191-fde914c31ab7', 'volume_name': 'volume-54359ee4-b095-40c5-a191-fde914c31ab7', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7f45b1-c4e8-4b33-bae4-e05e387e3749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7f45b1-c4e8-4b33-bae4-e05e387e3749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c08a8f4-c9f1-41b3-a185-39e605b7c320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:14 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Volume 54359ee4-b095-40c5-a191-fde914c31ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54359ee4-b095-40c5-a191-fde914c31ab7', 'volume_size': 1}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213515126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54359ee4-b095-40c5-a191-fde914c31ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:14Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Creating volume 54359ee4-b095-40c5-a191-fde914c31ab7 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:05:14 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:14 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7 1073741824
Jul 19 20:05:14 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:14 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7 1073741824" returned: 0 in 0.397s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:14 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:14 devstack sudo[107076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7
Jul 19 20:05:14 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:15 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7" returned: 0 in 0.241s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c08a8f4-c9f1-41b3-a185-39e605b7c320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54359ee4-b095-40c5-a191-fde914c31ab7', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6236737f-6d0f-40c9-b535-9067e9ce7db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:15 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Volume volume-54359ee4-b095-40c5-a191-fde914c31ab7 (54359ee4-b095-40c5-a191-fde914c31ab7): created successfully
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6236737f-6d0f-40c9-b535-9067e9ce7db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (b09c3ecb-ec2a-4a35-a224-8289c57a7197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:15 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0b960af8-3ea3-47bc-a1b6-750b7c8b1d8d tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot d3c33001-5536-4ca4-b090-d552150c7cdd of volume 54359ee4-b095-40c5-a191-fde914c31ab7 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f4d80-8541-4114-ae13-3bd14df9b468]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:15 devstack sudo[107079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7
Jul 19 20:05:15 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:15 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7" returned: 0 in 0.347s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:15 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:15 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd 1G
Jul 19 20:05:15 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:16 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd 1G" returned: 0 in 0.372s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54359ee4-b095-40c5-a191-fde914c31ab7 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:16 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54359ee4-b095-40c5-a191-fde914c31ab7 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd
Jul 19 20:05:16 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:16 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54359ee4-b095-40c5-a191-fde914c31ab7 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd" returned: 0 in 0.293s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:16 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd is being set with open permissions: ugo+rw
Jul 19 20:05:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:16 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd
Jul 19 20:05:16 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:16 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd" returned: 0 in 0.245s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:16 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:16 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.info
Jul 19 20:05:16 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:17 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.info" returned: 0 in 0.260s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:17 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.info is being set with open permissions: ugo+rw
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:17 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.info
Jul 19 20:05:17 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:17 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.info" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:17 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-26306192-d04f-4d20-bd39-3600add11c90 tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-d3c33001-5536-4ca4-b090-d552150c7cdd-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-d3c33001-5536-4ca4-b090-d552150c7cdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-54359ee4-b095-40c5-a191-fde914c31ab7" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-54359ee4-b095-40c5-a191-fde914c31ab7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-d3c33001-5536-4ca4-b090-d552150c7cdd" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-d3c33001-5536-4ca4-b090-d552150c7cdd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot d3c33001-5536-4ca4-b090-d552150c7cdd of volume 54359ee4-b095-40c5-a191-fde914c31ab7 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9fcee1-bfc5-41bd-8c87-60ba0d71fa56]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:17 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:17 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd
Jul 19 20:05:17 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:18 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd" returned: 0 in 0.367s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:18 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54359ee4-b095-40c5-a191-fde914c31ab7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:05:18 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[219b1f68-1b97-4539-8a47-4ff52662cfd2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:18 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7
Jul 19 20:05:18 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:18 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7" returned: 0 in 0.361s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:18 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd
Jul 19 20:05:18 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:18 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd" returned: 0 in 0.335s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:18 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:18 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd
Jul 19 20:05:18 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:19 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7.d3c33001-5536-4ca4-b090-d552150c7cdd" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-d3c33001-5536-4ca4-b090-d552150c7cdd" released by "_delete_snapshot" :: held 1.387s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-54359ee4-b095-40c5-a191-fde914c31ab7" released by "delete_snapshot" :: held 1.407s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Created reservations ['63eb141d-b5c9-433a-a646-5987fa32766a', '929420f4-3aab-4c6b-95f4-4147dbce871e', '469477a9-97c9-4fec-aa9d-d523840fea11', '37f83476-ebf7-4584-b922-cb73f8712a5c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:19 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-6593069b-f52d-4997-b7cd-2d1fffd7f88f tempest-ProjectMemberTests-1586216467 None] Lock "cinder-d3c33001-5536-4ca4-b090-d552150c7cdd-delete_snapshot" released by "delete_snapshot" :: held 1.538s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-54359ee4-b095-40c5-a191-fde914c31ab7-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-54359ee4-b095-40c5-a191-fde914c31ab7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-54359ee4-b095-40c5-a191-fde914c31ab7" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-54359ee4-b095-40c5-a191-fde914c31ab7" acquired by "delete_volume" :: waited 0.012s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab15ef-339e-475d-9d95-c8e9541bac7a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:19 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:20 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7
Jul 19 20:05:20 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:20 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7" returned: 0 in 0.346s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:20 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7
Jul 19 20:05:20 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:20 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-54359ee4-b095-40c5-a191-fde914c31ab7" returned: 0 in 0.244s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-54359ee4-b095-40c5-a191-fde914c31ab7" released by "delete_volume" :: held 0.643s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Created reservations ['2df020ed-c87e-479f-bf08-65bc4585b72d', '65567cae-d6ac-4920-a4ee-cf3b8e80fe10', '6588e22f-05f5-4b89-926b-a01ed5d120f0', '5845f236-fa2b-4eef-9f7a-66e56a5e0e7d'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:20 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:05:20 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:20 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.239s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:05:20 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:05:20 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e401ce31-7f1d-44ae-89c3-ea7ef63ba805 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-54359ee4-b095-40c5-a191-fde914c31ab7-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (8742ddef-56d7-4389-b4a2-79bd9cb12709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5eeb8f-5bbc-48be-9aa4-638b3dfb71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5eeb8f-5bbc-48be-9aa4-638b3dfb71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813774789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff68f7a-194f-4510-abbe-65b02631dc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:21Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de297f68-e48a-4f9d-a6b6-6ae0b5ff6248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de297f68-e48a-4f9d-a6b6-6ae0b5ff6248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83a0eb1-3cea-472f-bd07-fdc34c63f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83a0eb1-3cea-472f-bd07-fdc34c63f831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff68f7a-194f-4510-abbe-65b02631dc1b', 'volume_name': 'volume-3ff68f7a-194f-4510-abbe-65b02631dc1b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f6ceb0-1d71-4f44-8593-a42f54b5e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f6ceb0-1d71-4f44-8593-a42f54b5e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61c4b2e-7f84-4554-bb11-8db6ffb52920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:21 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Volume 3ff68f7a-194f-4510-abbe-65b02631dc1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff68f7a-194f-4510-abbe-65b02631dc1b', 'volume_size': 1}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813774789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff68f7a-194f-4510-abbe-65b02631dc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:21Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Creating volume 3ff68f7a-194f-4510-abbe-65b02631dc1b {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:05:21 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:21 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b 1073741824
Jul 19 20:05:21 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:21 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b 1073741824" returned: 0 in 0.410s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:21 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:22 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b
Jul 19 20:05:22 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:22 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b" returned: 0 in 0.239s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61c4b2e-7f84-4554-bb11-8db6ffb52920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff68f7a-194f-4510-abbe-65b02631dc1b', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f240a039-7e30-4893-bc1a-744e66d2a386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:22 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Volume volume-3ff68f7a-194f-4510-abbe-65b02631dc1b (3ff68f7a-194f-4510-abbe-65b02631dc1b): created successfully
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f240a039-7e30-4893-bc1a-744e66d2a386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (8742ddef-56d7-4389-b4a2-79bd9cb12709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:22 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-6a460c25-b124-4187-9e44-72cc03c829ce tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot ece73070-3271-450b-bb02-72e376c546a4 of volume 3ff68f7a-194f-4510-abbe-65b02631dc1b {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3aa28a-acef-47ee-9ccf-e6bb2656448f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:22 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:22 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b
Jul 19 20:05:22 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:23 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:23 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 1G
Jul 19 20:05:23 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:23 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 1G" returned: 0 in 0.384s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff68f7a-194f-4510-abbe-65b02631dc1b -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:23 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff68f7a-194f-4510-abbe-65b02631dc1b -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4
Jul 19 20:05:23 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:23 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff68f7a-194f-4510-abbe-65b02631dc1b -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4" returned: 0 in 0.287s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:23 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 is being set with open permissions: ugo+rw
Jul 19 20:05:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:23 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4
Jul 19 20:05:23 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:23 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4" returned: 0 in 0.250s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:23 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:24 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.info
Jul 19 20:05:24 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:24 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.info" returned: 0 in 0.238s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:24 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.info is being set with open permissions: ugo+rw
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:24 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.info
Jul 19 20:05:24 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:24 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.info" returned: 0 in 0.238s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:24 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-4607fb95-8b3c-455c-902b-1a55bb3795f2 tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-ece73070-3271-450b-bb02-72e376c546a4-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-ece73070-3271-450b-bb02-72e376c546a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-3ff68f7a-194f-4510-abbe-65b02631dc1b" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-3ff68f7a-194f-4510-abbe-65b02631dc1b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-ece73070-3271-450b-bb02-72e376c546a4" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-ece73070-3271-450b-bb02-72e376c546a4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot ece73070-3271-450b-bb02-72e376c546a4 of volume 3ff68f7a-194f-4510-abbe-65b02631dc1b {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[50400e89-4e64-4365-b10a-f11cf4c4b45b]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:24 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:24 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4
Jul 19 20:05:24 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:25 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4" returned: 0 in 0.342s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:25 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ff68f7a-194f-4510-abbe-65b02631dc1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:05:25 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[11751ea2-d50a-46a5-a4a1-d87c487cd817]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:25 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b
Jul 19 20:05:25 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:25 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b" returned: 0 in 0.346s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:25 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4
Jul 19 20:05:25 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:25 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4" returned: 0 in 0.336s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:25 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:25 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4
Jul 19 20:05:25 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:26 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b.ece73070-3271-450b-bb02-72e376c546a4" returned: 0 in 0.236s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-ece73070-3271-450b-bb02-72e376c546a4" released by "_delete_snapshot" :: held 1.345s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-3ff68f7a-194f-4510-abbe-65b02631dc1b" released by "delete_snapshot" :: held 1.368s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Created reservations ['e5054718-ab73-4cab-9ca8-907407750889', 'b712642e-7963-4d0f-982c-ab30e705c021', 'b4f9b85b-6995-4789-bd81-1451305ee356', '9da4523b-d627-45ab-920c-a88cd452c5e8'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:26 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-61d02704-0c75-4b79-a6ea-9d76bb74754d tempest-ProjectMemberTests-1586216467 None] Lock "cinder-ece73070-3271-450b-bb02-72e376c546a4-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-3ff68f7a-194f-4510-abbe-65b02631dc1b-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Lock "cinder-3ff68f7a-194f-4510-abbe-65b02631dc1b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-3ff68f7a-194f-4510-abbe-65b02631dc1b" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:26 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-3ff68f7a-194f-4510-abbe-65b02631dc1b" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6b0929-f993-419e-9a57-cdcdaaed9e2f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:27 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b
Jul 19 20:05:27 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:27 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b" returned: 0 in 0.342s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:27 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b
Jul 19 20:05:27 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:27 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-3ff68f7a-194f-4510-abbe-65b02631dc1b" returned: 0 in 0.246s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-3ff68f7a-194f-4510-abbe-65b02631dc1b" released by "delete_volume" :: held 0.640s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Created reservations ['0a6eb909-17c5-4a54-a91c-58463f437974', '7b0c8a9e-0c23-45ec-8b38-cb0e86911b49', '1d03801e-a056-45b2-9d11-e9d01391fc68', '828dfe1f-f827-4acb-8630-aa61b80bf71b'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:27 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:05:27 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:27 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.237s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:05:27 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:05:27 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-0ba1d914-a855-4d2e-a8c9-52c790421b5e tempest-ProjectMemberTests-1586216467 None] Lock "cinder-3ff68f7a-194f-4510-abbe-65b02631dc1b-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (81a0d345-53b1-497c-99c1-153ebe5957b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f18cad-c1f5-4c51-8af0-4d86d06175b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f18cad-c1f5-4c51-8af0-4d86d06175b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819829560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df76e52-4528-4fe8-8627-2840574d297e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:28Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a490556-d237-43c1-a8ca-8c8dcfb57ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a490556-d237-43c1-a8ca-8c8dcfb57ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fb60c5-e689-45fe-8936-9ea5ded70745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fb60c5-e689-45fe-8936-9ea5ded70745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df76e52-4528-4fe8-8627-2840574d297e', 'volume_name': 'volume-1df76e52-4528-4fe8-8627-2840574d297e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bfe6a7-9c6d-4448-bd4c-ec0400ae4b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bfe6a7-9c6d-4448-bd4c-ec0400ae4b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b643b40e-176e-479c-9c08-023a04087b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:28 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Volume 1df76e52-4528-4fe8-8627-2840574d297e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df76e52-4528-4fe8-8627-2840574d297e', 'volume_size': 1}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819829560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df76e52-4528-4fe8-8627-2840574d297e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:28Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Creating volume 1df76e52-4528-4fe8-8627-2840574d297e {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:05:28 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:28 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e 1073741824
Jul 19 20:05:28 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:28 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:28 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e 1073741824" returned: 0 in 0.407s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:29 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e
Jul 19 20:05:29 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:29 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e" returned: 0 in 0.239s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b643b40e-176e-479c-9c08-023a04087b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df76e52-4528-4fe8-8627-2840574d297e', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c698e0a-41eb-429e-95e2-8d62a4deca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:29 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Volume volume-1df76e52-4528-4fe8-8627-2840574d297e (1df76e52-4528-4fe8-8627-2840574d297e): created successfully
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c698e0a-41eb-429e-95e2-8d62a4deca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (81a0d345-53b1-497c-99c1-153ebe5957b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:29 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-ccb6f19d-2ba0-4307-a3a0-0b8599f96ac4 tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot 355a7218-29ed-4e80-bad1-90e92ef170e8 of volume 1df76e52-4528-4fe8-8627-2840574d297e {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ef6fe0-d7f4-44bf-96cd-b9d9d08eba0f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:29 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:29 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e
Jul 19 20:05:29 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:30 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e" returned: 0 in 0.349s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:30 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 1G
Jul 19 20:05:30 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:30 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 1G" returned: 0 in 0.381s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df76e52-4528-4fe8-8627-2840574d297e -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:30 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df76e52-4528-4fe8-8627-2840574d297e -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8
Jul 19 20:05:30 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:30 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1df76e52-4528-4fe8-8627-2840574d297e -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8" returned: 0 in 0.282s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:30 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 is being set with open permissions: ugo+rw
Jul 19 20:05:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:30 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8
Jul 19 20:05:30 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:30 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8" returned: 0 in 0.232s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:30 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:30 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.info
Jul 19 20:05:30 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:31 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.info" returned: 0 in 0.251s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:31 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.info is being set with open permissions: ugo+rw
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:31 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.info
Jul 19 20:05:31 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:31 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.info" returned: 0 in 0.243s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:31 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-c5218a7d-c04e-4a36-bf53-836733d9a0ab tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-355a7218-29ed-4e80-bad1-90e92ef170e8-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Lock "cinder-355a7218-29ed-4e80-bad1-90e92ef170e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-1df76e52-4528-4fe8-8627-2840574d297e" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-1df76e52-4528-4fe8-8627-2840574d297e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-355a7218-29ed-4e80-bad1-90e92ef170e8" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-355a7218-29ed-4e80-bad1-90e92ef170e8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot 355a7218-29ed-4e80-bad1-90e92ef170e8 of volume 1df76e52-4528-4fe8-8627-2840574d297e {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[a520b5d5-d074-4b52-8ee9-ecc80f0ed51f]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:31 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:31 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8
Jul 19 20:05:31 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:32 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8" returned: 0 in 0.348s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1df76e52-4528-4fe8-8627-2840574d297e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[73066ec2-f295-4ee8-a766-645273cb321a]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:32 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e
Jul 19 20:05:32 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:32 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e" returned: 0 in 0.342s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:32 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8
Jul 19 20:05:32 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:32 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:05:32 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:32 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8" returned: 0 in 0.343s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:32 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:32 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8
Jul 19 20:05:32 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:33 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.243s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG oslo_service.periodic_task [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] Running periodic task VolumeManager._thread_info {{(pid=87353) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread count: 28 {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-ef50c108-91a7-4644-bf65-d5b235d18ca5 None None] thread info: [<_MainThread(MainThread, started 139930907525248)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139930798545792)>, <Thread(Thread-3 (stat_writer), started daemon 139930796279488)>, <Thread(Rabbit-heartbeat, started daemon 139930795899712)>, <Thread(Thread-5 (_runner), started daemon 139930796048512)>, <Thread(Thread-7 (_runner), started daemon 139930794054208)>, <Thread(fd_logger, started daemon 139930789740736)>, <Thread(privsep_reader, started daemon 139930789707392)>, <Thread(tpool_thread_0, started daemon 139930783323840)>, <Thread(tpool_thread_1, started daemon 139930774931136)>, <Thread(tpool_thread_2, started daemon 139930766538432)>, <Thread(tpool_thread_3, started daemon 139930758145728)>, <Thread(tpool_thread_4, started daemon 139930749753024)>, <Thread(tpool_thread_5, started daemon 139930741343936)>, <Thread(tpool_thread_6, started daemon 139930732934848)>, <Thread(tpool_thread_7, started daemon 139930724525760)>, <Thread(tpool_thread_8, started daemon 139930716116672)>, <Thread(tpool_thread_9, started daemon 139930707707584)>, <Thread(tpool_thread_10, started daemon 139930699298496)>, <Thread(tpool_thread_11, started daemon 139930690889408)>, <Thread(tpool_thread_12, started daemon 139930682480320)>, <Thread(tpool_thread_13, started daemon 139930674071232)>, <Thread(tpool_thread_14, started daemon 139930665662144)>, <Thread(tpool_thread_15, started daemon 139930657253056)>, <Thread(tpool_thread_16, started daemon 139930648843968)>, <Thread(tpool_thread_17, started daemon 139930640434880)>, <Thread(tpool_thread_18, started daemon 139930632025792)>, <Thread(tpool_thread_19, started daemon 139930623616704)>] {{(pid=87353) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 19 20:05:33 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e.355a7218-29ed-4e80-bad1-90e92ef170e8" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-355a7218-29ed-4e80-bad1-90e92ef170e8" released by "_delete_snapshot" :: held 1.355s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-1df76e52-4528-4fe8-8627-2840574d297e" released by "delete_snapshot" :: held 1.375s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Created reservations ['acd74371-981d-4d12-bf8f-292b42f0ef47', 'b5a81640-41bf-4b29-93c2-4bc0b7d9946d', 'edd56ba5-fd4a-44f4-a2d3-0a95d781fff9', '1742dfb4-72c5-41bd-8959-5a1b3daa33c1'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:33 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f42916a9-5695-410f-8bb2-c4daa95999ac tempest-ProjectMemberTests-1586216467 None] Lock "cinder-355a7218-29ed-4e80-bad1-90e92ef170e8-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-1df76e52-4528-4fe8-8627-2840574d297e-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Lock "cinder-1df76e52-4528-4fe8-8627-2840574d297e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-1df76e52-4528-4fe8-8627-2840574d297e" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:33 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-1df76e52-4528-4fe8-8627-2840574d297e" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbb99bf-f040-4140-a4c9-3a3e9deeffa5]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:34 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e
Jul 19 20:05:34 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:34 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e" returned: 0 in 0.343s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:34 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e
Jul 19 20:05:34 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:34 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-1df76e52-4528-4fe8-8627-2840574d297e" returned: 0 in 0.247s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-1df76e52-4528-4fe8-8627-2840574d297e" released by "delete_volume" :: held 0.646s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Created reservations ['d89036bd-287f-46c4-960a-b9d7efa1cd04', 'efb49e5f-35ef-492c-9f51-4982f93f248d', 'ab22d2a7-c402-4331-bc3e-028d023f27e2', '4ce24cc6-680d-4f93-bdd6-0756431e31eb'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:34 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:05:34 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:34 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.236s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:34 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:05:34 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-7c45c117-9da0-4d17-b3ea-8735fdb9563a tempest-ProjectMemberTests-1586216467 None] Lock "cinder-1df76e52-4528-4fe8-8627-2840574d297e-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (39f9cb6a-bfd4-465d-be61-affe90fe3469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9577c8f-a9b7-4ec1-ac82-99e5309e75a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9577c8f-a9b7-4ec1-ac82-99e5309e75a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819432257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125050c7-61bf-46be-90d0-f26ef14e2945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:35Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d259a3c1-a088-4d79-859c-23ca22995772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d259a3c1-a088-4d79-859c-23ca22995772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca36508-190a-449c-b811-cce150f723f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca36508-190a-449c-b811-cce150f723f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125050c7-61bf-46be-90d0-f26ef14e2945', 'volume_name': 'volume-125050c7-61bf-46be-90d0-f26ef14e2945', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f6f2cd-b2c0-4925-bd46-a289107545f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f6f2cd-b2c0-4925-bd46-a289107545f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a782119-2de5-4803-b361-77f4986b1ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:35 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Volume 125050c7-61bf-46be-90d0-f26ef14e2945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125050c7-61bf-46be-90d0-f26ef14e2945', 'volume_size': 1}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819432257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125050c7-61bf-46be-90d0-f26ef14e2945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:35Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Creating volume 125050c7-61bf-46be-90d0-f26ef14e2945 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:05:35 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:35 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945 1073741824
Jul 19 20:05:35 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:35 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:35 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945 1073741824" returned: 0 in 0.384s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:36 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945
Jul 19 20:05:36 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:36 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945" returned: 0 in 0.241s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a782119-2de5-4803-b361-77f4986b1ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125050c7-61bf-46be-90d0-f26ef14e2945', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989efb70-047d-453b-8433-d9eea090b356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:36 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Volume volume-125050c7-61bf-46be-90d0-f26ef14e2945 (125050c7-61bf-46be-90d0-f26ef14e2945): created successfully
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989efb70-047d-453b-8433-d9eea090b356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (39f9cb6a-bfd4-465d-be61-affe90fe3469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:36 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-b209521c-f48c-4243-ab25-19930967a720 tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot 3d34f595-e10a-4896-b792-392443104caa of volume 125050c7-61bf-46be-90d0-f26ef14e2945 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512faa0-5bb6-49ed-a3c2-7e9caf20af66]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:36 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:36 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945
Jul 19 20:05:36 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:37 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945" returned: 0 in 0.344s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:37 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa 1G
Jul 19 20:05:37 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:37 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa 1G" returned: 0 in 0.377s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125050c7-61bf-46be-90d0-f26ef14e2945 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:37 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125050c7-61bf-46be-90d0-f26ef14e2945 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa
Jul 19 20:05:37 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:37 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-125050c7-61bf-46be-90d0-f26ef14e2945 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa" returned: 0 in 0.289s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:37 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa is being set with open permissions: ugo+rw
Jul 19 20:05:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:37 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa
Jul 19 20:05:37 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:37 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:37 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:37 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.info
Jul 19 20:05:37 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:38 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.info" returned: 0 in 0.257s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:38 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.info is being set with open permissions: ugo+rw
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:38 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.info
Jul 19 20:05:38 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:38 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.info" returned: 0 in 0.236s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:38 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-16bf5514-0750-411e-a870-d389391d806e tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-3d34f595-e10a-4896-b792-392443104caa-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-3d34f595-e10a-4896-b792-392443104caa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-125050c7-61bf-46be-90d0-f26ef14e2945" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-125050c7-61bf-46be-90d0-f26ef14e2945" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-3d34f595-e10a-4896-b792-392443104caa" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-3d34f595-e10a-4896-b792-392443104caa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot 3d34f595-e10a-4896-b792-392443104caa of volume 125050c7-61bf-46be-90d0-f26ef14e2945 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[5348c756-35e5-4537-bb88-576f908bc7e4]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:38 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:38 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa
Jul 19 20:05:38 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:39 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa" returned: 0 in 0.351s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:39 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-125050c7-61bf-46be-90d0-f26ef14e2945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:05:39 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[59801f43-0bdb-42d5-8ce9-421016b4ef6c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:39 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945
Jul 19 20:05:39 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:39 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945" returned: 0 in 0.344s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:39 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa
Jul 19 20:05:39 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:39 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa" returned: 0 in 0.326s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:39 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:39 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa
Jul 19 20:05:39 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:40 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945.3d34f595-e10a-4896-b792-392443104caa" returned: 0 in 0.247s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-3d34f595-e10a-4896-b792-392443104caa" released by "_delete_snapshot" :: held 1.349s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-125050c7-61bf-46be-90d0-f26ef14e2945" released by "delete_snapshot" :: held 1.369s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Created reservations ['76c7282e-fb6d-451e-b33c-9cf96fd9ee16', '6003baa2-b54b-490f-83d7-4ff13bfefde3', '4222d510-e165-4e85-8ea8-a7d7d74bb20c', 'd479c284-9af9-40d5-8678-de4afdc819ae'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:40 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-9cfdab77-2620-4a15-8f93-ed44847d67fa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-3d34f595-e10a-4896-b792-392443104caa-delete_snapshot" released by "delete_snapshot" :: held 1.500s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-125050c7-61bf-46be-90d0-f26ef14e2945-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-125050c7-61bf-46be-90d0-f26ef14e2945-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-125050c7-61bf-46be-90d0-f26ef14e2945" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:40 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-125050c7-61bf-46be-90d0-f26ef14e2945" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[6472a184-cead-46f3-addf-2edfdc3dc1ac]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:41 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945
Jul 19 20:05:41 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:41 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:41 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945
Jul 19 20:05:41 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:41 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-125050c7-61bf-46be-90d0-f26ef14e2945" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-125050c7-61bf-46be-90d0-f26ef14e2945" released by "delete_volume" :: held 0.649s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Created reservations ['62b7f27d-564b-4a0c-b8f3-6dd9c02775a2', 'f25fdb27-079a-41cd-9e8e-767a19efaf31', '6309a900-c6e9-4b8d-829a-81d6b1bd1e3b', 'd730baab-a7ac-4b6d-a03b-3bb2ff12bb86'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:41 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:05:41 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:41 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.241s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:41 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:05:41 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-f3c49d78-de20-4065-b1e8-a81621fcf2c9 tempest-ProjectMemberTests-1586216467 None] Lock "cinder-125050c7-61bf-46be-90d0-f26ef14e2945-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87353) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (36c6cd87-28e2-4bc2-b978-cff09aabd87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87afb89d-c651-4669-9b5f-0aafdf96e045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87afb89d-c651-4669-9b5f-0aafdf96e045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451666914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42c9769-edf7-4243-b250-b9bd256ca645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:42Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3420ff3-409b-4f9a-a3a9-1d0c2d72ff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3420ff3-409b-4f9a-a3a9-1d0c2d72ff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517a5602-003d-4c1b-b564-ff2fc6b713d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517a5602-003d-4c1b-b564-ff2fc6b713d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42c9769-edf7-4243-b250-b9bd256ca645', 'volume_name': 'volume-b42c9769-edf7-4243-b250-b9bd256ca645', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52270135-8109-4e73-8c86-6b2c620ecfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52270135-8109-4e73-8c86-6b2c620ecfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11bdf79-83de-4e08-aaa3-2da4cd7a01c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:42 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Volume b42c9769-edf7-4243-b250-b9bd256ca645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42c9769-edf7-4243-b250-b9bd256ca645', 'volume_size': 1}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f442da9e180>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-19T18:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451666914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42c9769-edf7-4243-b250-b9bd256ca645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ad6b00960bb453183810de9cc48811b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-19T18:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-19T18:05:42Z,use_quota=True,user_id='cef8db6ad5d0438aae97c6b7e6994e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42280ef2-6a38-4c5a-b765-6c88ffdc7098),volume_type_id=42280ef2-6a38-4c5a-b765-6c88ffdc7098)}" {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Creating volume b42c9769-edf7-4243-b250-b9bd256ca645 {{(pid=87353) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Selected osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237 as target Quobyte volume. {{(pid=87353) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 19 20:05:42 devstack cinder-volume[87353]: INFO cinder.volume.drivers.remotefs [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] casted to osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645 1073741824 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:42 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645 1073741824
Jul 19 20:05:42 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:42 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:42 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645 1073741824" returned: 0 in 0.401s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:43 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645
Jul 19 20:05:43 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:43 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645" returned: 0 in 0.240s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'} {{(pid=87353) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11bdf79-83de-4e08-aaa3-2da4cd7a01c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42c9769-edf7-4243-b250-b9bd256ca645', 'volume_size': 1}' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41938910-165b-44a4-b641-f021c5b865ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 19 20:05:43 devstack cinder-volume[87353]: INFO cinder.volume.flows.manager.create_volume [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Volume volume-b42c9769-edf7-4243-b250-b9bd256ca645 (b42c9769-edf7-4243-b250-b9bd256ca645): created successfully
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41938910-165b-44a4-b641-f021c5b865ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87353) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Flow 'volume_create_manager' (36c6cd87-28e2-4bc2-b978-cff09aabd87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87353) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 19 20:05:43 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-1d3f4e25-38ed-400f-9f14-d4ce5c1b81d6 tempest-ProjectMemberTests-1586216467 None] Created volume successfully.
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Creating offline snapshot 43960e42-f670-4edc-a9e2-10c0149dedb2 of volume b42c9769-edf7-4243-b250-b9bd256ca645 {{(pid=87353) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[57290017-1bb2-46f0-95d7-39a3ba3d05e2]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:43 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:43 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645
Jul 19 20:05:43 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:44 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645" returned: 0 in 0.357s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 1G {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:44 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 1G
Jul 19 20:05:44 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:44 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 1G" returned: 0 in 0.382s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b42c9769-edf7-4243-b250-b9bd256ca645 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:44 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b42c9769-edf7-4243-b250-b9bd256ca645 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2
Jul 19 20:05:44 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:44 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b42c9769-edf7-4243-b250-b9bd256ca645 -F qcow2 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2" returned: 0 in 0.288s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:44 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 is being set with open permissions: ugo+rw
Jul 19 20:05:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:44 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2
Jul 19 20:05:44 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:44 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2" returned: 0 in 0.253s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:44 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:45 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.info
Jul 19 20:05:45 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:45 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.info" returned: 0 in 0.241s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:45 devstack cinder-volume[87353]: WARNING cinder.volume.drivers.remotefs [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.info is being set with open permissions: ugo+rw
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.info {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:45 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.info
Jul 19 20:05:45 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:45 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.info" returned: 0 in 0.241s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:45 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-2ab73074-974e-43c4-a007-893dad638a94 tempest-ProjectMemberTests-1586216467 None] Create snapshot completed successfully
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-43960e42-f670-4edc-a9e2-10c0149dedb2-delete_snapshot" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-43960e42-f670-4edc-a9e2-10c0149dedb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-b42c9769-edf7-4243-b250-b9bd256ca645" by "delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-b42c9769-edf7-4243-b250-b9bd256ca645" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-43960e42-f670-4edc-a9e2-10c0149dedb2" by "_delete_snapshot" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-43960e42-f670-4edc-a9e2-10c0149dedb2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Deleting offline snapshot 43960e42-f670-4edc-a9e2-10c0149dedb2 of volume b42c9769-edf7-4243-b250-b9bd256ca645 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] snapshot_file for this snap is: volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 {{(pid=87353) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa8cdfb-c054-449e-8690-cec5727e1ffd]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:45 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:46 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2
Jul 19 20:05:46 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:46 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2" returned: 0 in 0.345s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:46 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.remotefs [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b42c9769-edf7-4243-b250-b9bd256ca645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87353) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 19 20:05:46 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb9d6f9-79c2-4246-b9c8-da8d8d92cbba]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:46 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645
Jul 19 20:05:46 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:46 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645" returned: 0 in 0.361s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:46 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2
Jul 19 20:05:46 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:46 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2" returned: 0 in 0.336s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:46 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:47 devstack sudo[107423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2
Jul 19 20:05:47 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:47 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:47 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645.43960e42-f670-4edc-a9e2-10c0149dedb2" returned: 0 in 0.241s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-43960e42-f670-4edc-a9e2-10c0149dedb2" released by "_delete_snapshot" :: held 1.364s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-b42c9769-edf7-4243-b250-b9bd256ca645" released by "delete_snapshot" :: held 1.387s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:47 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Created reservations ['bdc9830e-f29a-491d-ba25-93b6e22b9aad', 'a9c05b3c-e007-427c-807d-e5d4e2fcd5e7', '4d8fc648-4016-4c2b-b931-8b2437441c0d', 'e042760e-1029-4d11-87bc-4d558916ffc0'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:47 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Delete snapshot completed successfully.
Jul 19 20:05:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-dcf0318e-7e5e-43a2-871e-dff3659b8aaa tempest-ProjectMemberTests-1586216467 None] Lock "cinder-43960e42-f670-4edc-a9e2-10c0149dedb2-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:47 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-b42c9769-edf7-4243-b250-b9bd256ca645-delete_volume" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Lock "cinder-b42c9769-edf7-4243-b250-b9bd256ca645-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Acquiring lock "cinder-quobyte-b42c9769-edf7-4243-b250-b9bd256ca645" by "delete_volume" {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-b42c9769-edf7-4243-b250-b9bd256ca645" acquired by "delete_volume" :: waited 0.015s {{(pid=87353) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb04375-e2b4-43f8-808d-96cefa02324c]: (4, 'qcow2') {{(pid=88926) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:48 devstack sudo[107426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645
Jul 19 20:05:48 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:48 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645" returned: 0 in 0.354s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645 {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:48 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645
Jul 19 20:05:48 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:48 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af/volume-b42c9769-edf7-4243-b250-b9bd256ca645" returned: 0 in 0.246s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Lock "cinder-quobyte-b42c9769-edf7-4243-b250-b9bd256ca645" released by "delete_volume" :: held 0.654s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG cinder.quota [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Created reservations ['68e1c023-eeae-479e-85b5-9da4c731a35a', 'ee21df20-6e0a-4965-bb85-9425b5a4881a', '3d601dac-36ad-4f72-8a6f-ccee6ddc0113', '562ce698-bb1f-4395-a37a-20eec3fa3f8c'] {{(pid=87353) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237': None} {{(pid=87353) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG cinder.volume.drivers.quobyte [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6763f7ca-d648-4707-8f73-a4940b66e237'] {{(pid=87353) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.lockutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87353) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 19 20:05:48 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 19 20:05:48 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af
Jul 19 20:05:48 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 19 20:05:49 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Jul 19 20:05:49 devstack cinder-volume[87353]: DEBUG oslo_concurrency.processutils [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d9b6b84b75eb4d2d287583d568105af" returned: 0 in 0.249s {{(pid=87353) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 19 20:05:49 devstack cinder-volume[87353]: DEBUG cinder.manager [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Notifying Schedulers of capabilities ... {{(pid=87353) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 19 20:05:49 devstack cinder-volume[87353]: INFO cinder.volume.manager [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Deleted volume successfully.
Jul 19 20:05:49 devstack cinder-volume[87353]: DEBUG cinder.coordination [None req-e329d836-c4f1-4833-b6d2-0970510b7bca tempest-ProjectMemberTests-1586216467 None] Lock "cinder-b42c9769-edf7-4243-b250-b9bd256ca645-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87353) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 19 20:05:58 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=108,cinder:INSERT=38,cinder:UPDATE=149,cinder:DELETE=11 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 19 20:05:59 devstack cinder-volume[87353]: DEBUG dbcounter [-] [87353] Writing DB stats cinder:SELECT=108,cinder:INSERT=40,cinder:UPDATE=131,cinder:DELETE=11 {{(pid=87353) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}